GPU

4 articles tagged with "GPU"

Is Meta Compute a Sign of an AI Bubble Collapse? Insight

Is Meta Compute a Sign of an AI Bubble Collapse?

Meta's plan to rent out spare AI compute spooked Neocloud stocks. But looking at pricing, capex, and ad AI, I read Meta Compute not as a sign of compute deflation, but as data centers becoming a rental asset with several revenue routes.

Read →
From Semiconductors to Gold, Real Estate, and Subprime: The Financialization and Risk of AI Infrastructure Insight

From Semiconductors to Gold, Real Estate, and Subprime: The Financialization and Risk of AI Infrastructure

GPUs and ASICs are turning from parts into a store of value, then real estate, then leveraged financial products. I trace CoreWeave, SPVs, and the move into leveraged loans and CLOs, and check the structural similarities to the 2008 subprime crisis with a calm eye on the risk.

Read →
Part 3: LoRA and Quantization Explained -- The Techniques That Make LLMs Lighter Series

Part 3: LoRA and Quantization Explained -- The Techniques That Make LLMs Lighter

A deep dive into LoRA, quantization, QLoRA, and SFTTrainer -- the key techniques that enable fine-tuning large language models on consumer hardware, validated through a Mount Fuji proof-of-concept experiment.

Read →
Part 2: The Local GPU Challenge and Defeat -- Taking on an 8B Model with 6 GB of VRAM on the RTX 3060 Series

Part 2: The Local GPU Challenge and Defeat -- Taking on an 8B Model with 6 GB of VRAM on the RTX 3060

My first attempt at fine-tuning ELYZA Llama-3-JP-8B on a local RTX 3060 GPU, and the hard lessons learned about VRAM limitations when training large language models.

Read →