LoRA

2 articles tagged with "LoRA"

Part 3: LoRA and Quantization Explained -- The Techniques That Make LLMs Lighter Series

Part 3: LoRA and Quantization Explained -- The Techniques That Make LLMs Lighter

A deep dive into LoRA, quantization, QLoRA, and SFTTrainer -- the key techniques that enable fine-tuning large language models on consumer hardware, validated through a Mount Fuji proof-of-concept experiment.

Read →
Part 4: Stock Prediction on Colab -- Trial and Error with Three Models Series

Part 4: Stock Prediction on Colab -- Trial and Error with Three Models

Fine-tuning ELYZA 8B and LLM-jp 7.2B for stock price prediction on Google Colab, the accuracy challenges encountered, and why I ultimately pivoted to the OpenAI API.

Read →