LLM

21 articles tagged with "LLM"

Part 3. Build Your Own Real-Time Translator - Ollama, LM Studio, and Home GPU Series

Part 3. Build Your Own Real-Time Translator - Ollama, LM Studio, and Home GPU

Local LLM inference on RTX 3060: Ollama setup and VRAM crash, LM Studio 0.4.0 headless CLI, lock mechanisms for parallel requests, mobile LLM feasibility research, and a guide for adapting to any language pair.

Read →
Part 2. Build Your Own Real-Time Translator - LLM Streaming for 500ms Series

Part 2. Build Your Own Real-Time Translator - LLM Streaming for 500ms

The core implementation: dual prompts for speed vs quality, streaming JSON extraction, debounce logic, and progressive frontend display — with full code.

Read →
Part 1. Build Your Own Real-Time Translator - Intent-First, Breaking the Silence Series

Part 1. Build Your Own Real-Time Translator - Intent-First, Breaking the Silence

Why existing voice translators break conversation flow, and how to set up the foundation for a real-time translator with Deepgram, FastAPI, and WebSocket.

Read →