#LLM fine-tuning low VRAM
157 related articles
·3 min
Unsloth Now Supports AMD GPUs: 2x Training Speedup and 70% VRAM Savings Across 500+ Models
Unsloth officially supports AMD GPUs across RDNA 3-4, Strix Halo, and MI300 series, delivering 2x training speedup and 70% VRAM savings on 500+ models with RL and vLLM weight sharing support.
Read more →
·3 min
Fine-Tuning 8B LLMs on a 4GB GPU: A Deep Dive into VRAM Optimization Techniques
Learn how to fine-tune 8B parameter LLMs on a 4GB laptop GPU using QLoRA quantization, gradient checkpointing, and gradient accumulation VRAM optimization techniques.
Read more →
·3 min
Open Source Wins: How China Is Using Open Source Strategy to Dominate the Second Half of AI
Chinese open-source AI models are rapidly rising with near-top performance at fraction of cost, dominating local deployment. As the gap shrinks to single digits and OpenAI cuts prices, open source is reshaping AI competition.
Read more →
·3 min
LLM Post-Training on an 8GB GPU: A Practical Guide to SFT, DPO, and GRPO
Learn how to complete LLM post-training on a consumer GPU with just 8GB VRAM, covering SFT, DPO, and GRPO methods using LoRA quantization and other techniques.
Read more →
·3 min
Ollama + Qwen-Agent: Building a Local Private AI Assistant — From Deployment to Security Best Practices
A complete guide to building a local private AI assistant with Ollama and Qwen-Agent. Covers RAG knowledge integration, voice interaction, and permission isolation for a secure local AI Agent architecture.
Read more →
·3 min
Self-Hosting a Code Review AI Agent: From Architecture Design to Engineering Implementation
A deep dive into building and self-hosting a code review AI Agent from scratch, covering architecture design, context management, model selection, and noise control.
Read more →
·2 min
DeepSeek V4 Flash Weights Open-Sourced: A New Option for Lightweight LLM Deployment
DeepSeek V4 Flash model weights reportedly open-sourced. This article analyzes its lightweight positioning, open-weight value, comparisons with closed-source models, and deployment guidance.
Read more →
·2 min
Behind the Open-Source Model Frenzy: Who Will Provide Cheap Inference Services?
Open-source LLM weights don't equal low-cost access for developers. This article analyzes the inference service gap in open-source AI and how providers like Together AI and Groq are addressing it.
Read more →
·3 min
Complete Guide to Running Claude Code with Ollama: API Error Troubleshooting & Local Model Optimization
Guide to running Claude Code via Ollama locally: troubleshooting API errors, output token limits, model freezes, with model selection, parameter tuning, and alternative tool recommendations.
Read more →
·3 min
Backend Developer Transition to AI/LLM: 4 Core Skills and a Practical Learning Roadmap
Complete guide for backend developers transitioning to AI/LLM engineering. Covers the 4 core skills—Python, RAG, Fine-tuning, and Agents—with a phased learning roadmap and practical project advice.
Read more →
·4 min
Kimi K2/K3 Technical Speculation: Deep Dive into RL Hyperparameters and Multi-Teacher Distillation
Deep analysis of RL hyperparameter tuning challenges and 9-policy multi-teacher distillation in Kimi K2/K3 training, exploring the shift from scale to training craft.
Read more →
·3 min
A 9B Model Beats Frontier LLMs After Just $500 in RL Fine-Tuning
Just $500 in RL fine-tuning enables a 9B open-source model to outperform frontier LLMs on catalog review tasks. Analysis of when small-model RL works and its enterprise implications.
Read more →
·3 min
From RAG to Agent Tuning: A Complete Guide to Deploying LLM Agents
A deep dive into LLM Agent frameworks covering RAG, Agent core components (tools, memory, planning), and Agent Tuning workflows with cost considerations for production deployment.
Read more →
·3 min
DeepSeek-OCR Deployment & Fine-Tuning in Practice: From vLLM Inference to Unsloth Fine-Tuning
Complete guide to DeepSeek-OCR from vLLM inference deployment and Unsloth model loading to fine-tuning, covering cloud server setup, GPU selection, and code examples — all on a single 4090 GPU.
Read more →
·2 min
RX 9060 XT vs RTX 5060 Ti: Which GPU to Pick for Local AI?
RX 9060 XT vs RTX 5060 Ti — both 16GB VRAM, but which is better for local AI? We compare CUDA ecosystem, ROCm compatibility, LLM inference, and real-world usability.
Read more →
·2 min
RX 9060 XT vs RTX 5060 Ti: How to Choose a GPU for Local AI
RX 9060 XT vs RTX 5060 Ti both offer 16GB VRAM — which is better for local AI inference? A full comparison of CUDA ecosystem, ROCm compatibility, LLM performance, and real-world usability.
Read more →
·7 min
The Complete AI Character LoRA Training Workflow: Hands-On Multi-Character Consistency Generation with Local Deployment
A detailed guide to a complete local AI character generation workflow: from the five golden rules of LoRA training and automated ComfyUI dataset construction to hands-on comparisons of Crea2, Ideogram4, and Wan for multi-character same-frame interaction—all running free on personal hardware.
Read more →
·3 min
Agent Fine-Tuning in Practice: A Complete Guide to Training Your Own AI Agent
A deep dive into Agent Tuning: from LLM hallucination and staleness issues to RAG vs. Agent architecture, the 4-step fine-tuning process, and cost analysis for building your own AI agent.
Read more →
·3 min
Frontend Developers Transitioning to AI: A Complete Three-Phase Minimalist Roadmap
A structured 3-phase roadmap for frontend developers transitioning to AI: master Transformer fundamentals, build RAG & Agent skills, then advance to model fine-tuning.
Read more →
·2 min
Qwen3 Fine-Tuning in Practice: A Complete Guide to Local Deployment and Domain Training
A hands-on guide to LLM fine-tuning: from understanding model weights to local Qwen3 deployment, dataset preparation, and domain-specific training. Build a complete AI engineering skill set.
Read more →