#Unsloth

43 related articles

Aug 6, 2026·3 min

Unsloth Teams Up with Thinking Machines: Dynamic 1-bit Quantization Achieves 86% Compression, Running Multimodal LLMs in 270GB

Unsloth and Thinking Machines release dynamic 1-bit GGUF quantization for Inkling, compressing the model from 1.9TB to 270GB (86% reduction) while retaining 74.2% accuracy and adding vision/audio multimodal support.

Aug 6, 2026·3 min

Unsloth Now Supports AMD GPUs: 2x Training Speedup and 70% VRAM Savings Across 500+ Models

Unsloth officially supports AMD GPUs across RDNA 3-4, Strix Halo, and MI300 series, delivering 2x training speedup and 70% VRAM savings on 500+ models with RL and vLLM weight sharing support.

Jul 27, 2026·3 min

DeepSeek-OCR Deployment & Fine-Tuning in Practice: From vLLM Inference to Unsloth Fine-Tuning

Complete guide to DeepSeek-OCR from vLLM inference deployment and Unsloth model loading to fine-tuning, covering cloud server setup, GPU selection, and code examples — all on a single 4090 GPU.

Jul 12, 2026·4 min

Unsloth Releases Qwen3.6 NVFP4 Quantization: 2.5x Faster with Zero Accuracy Loss

Unsloth releases NVFP4 quantization for Qwen3.6 using W4A4 true 4-bit Tensor Core computation, delivering up to 2.5x inference speedup over NVIDIA's official implementation with accuracy matching or exceeding BF16 on benchmarks like MMLU-Pro.

Jul 10, 2026·2 min

Unsloth v0.1.462-beta: Keyboard Navigation and Accessibility Improvements for Model Picker

Unsloth v0.1.462-beta adds full keyboard navigation to the Studio Model Picker, fixes Tab focus order, and improves accessibility for LLM fine-tuning workflows.

Jul 9, 2026·4 min

Unsloth v0.1.463-beta: Fixes Studio Crash and llama-server Permission Issue

Unsloth v0.1.463-beta fixes a Studio crash caused by access-denied errors during llama-server service discovery. Improves stability for multi-user servers and Windows environments.

Jul 9, 2026·6 min

Unsloth Major Update: DeepSeek-V4 Support and a Deep Dive into NVFP4 Quantized Export

Unsloth v0.1.481-beta adds full DeepSeek-V4-Flash support, NVFP4/FP8/imatrix GGUF quantized export, 1.3x faster GRPO, 3-5x faster MoE training, and an OpenAI-compatible API service in Studio.

Jul 8, 2026·5 min

Major Unsloth Update: NVFP4 Quantization Export and DeepSeek-V4 Training Support

Unsloth v0.1.48-beta released, adding NVFP4/FP8 quantization export, OpenAI-compatible API hot-swapping, 3-5x faster MoE training, and 1.3x faster GRPO, covering the full LLM fine-tuning, quantization, and local deployment pipeline.

Jul 8, 2026·2 min

Unsloth v0.1.45 Released: Gemma 4 MTP Acceleration, Cross-Platform Fixes, and Studio Upgrades

Unsloth v0.1.45-beta adds Gemma 4 MTP support, AMD ROCm & NVIDIA Blackwell fixes, a new Hub download manager, and a compact RAG system for local LLM fine-tuning.

Jul 8, 2026·3 min

Unsloth v0.1.46-beta Update: DiffusionGemma Tool Calling Disabled and Artifacts Canvas Enabled by Default

Unsloth v0.1.46-beta is out with key DiffusionGemma changes: tool calling disabled by default, artifacts canvas enabled. A deep dive for LLM fine-tuning devs.

Jul 8, 2026·2 min

Unsloth v0.1.461-beta: Fix for Local GGUF Vision Model Loading

Unsloth v0.1.461-beta fixes local GGUF vision model loading on llama-server in Studio, adds variant directory companion file lookup for stable multimodal deployment.

Jul 8, 2026·3 min

Unsloth v0.1.45-beta Released: 2x Faster LLM Fine-Tuning with 70% Less VRAM

Unsloth v0.1.45-beta (PyPI: 2026.6.2) delivers 2x faster LLM fine-tuning and up to 70% VRAM reduction. Now at 67.9k GitHub stars, upgrade via pip install.

Jul 7, 2026·3 min

Unsloth Major Update: GLM-5.2 Support, 3x Longer Context, and a New Model Hub

Unsloth v0.1.471-beta adds full GLM-5.2 support, 3x longer context (up to 200K tokens on a single GPU), a new Model Hub, and Chat Canvas — a major leap for local LLM fine-tuning.

Jul 7, 2026·3 min

Unsloth Major Update: DiffusionGemma & Gemma 4 MTP Support, 2x Inference Speed Boost

Unsloth v0.1.464-beta adds DiffusionGemma, Gemma 4 MTP, and MiniMax-M3 support, delivering ~2x inference speed boost, new Hub, RAG Q&A, tensor parallelism, and full CUDA/ROCm/Windows coverage.

Jul 7, 2026·1 min

Unsloth v0.1.47-beta Released: 2x Faster LLM Fine-Tuning with 70% Less VRAM

Unsloth v0.1.47-beta is out. This 67.9k-star open-source framework fine-tunes Llama, Mistral, and Qwen 2x faster with 70% less VRAM on consumer GPUs.

Unsloth: 80% VRAM Reduction — The Best Open-Source Tool for Local LLM Fine-Tuning

Product Reviews

May 13, 2026·2 min

Unsloth: 80% VRAM Reduction — The Best Open-Source Tool for Local LLM Fine-Tuning

Unsloth is an open-source LLM training tool with 63K+ GitHub stars, supporting Gemma 4, Qwen 3, DeepSeek. Reduces VRAM by 50–80%, enabling RTX 4090 to fine-tune 7B models with a no-code Web UI.

Unsloth Tutorial: Fine-Tune LLMs Locally with 5x Speed and Massive VRAM Savings

Tutorials

May 7, 2026·2 min

Unsloth Tutorial: Fine-Tune LLMs Locally with 5x Speed and Massive VRAM Savings

Learn how Unsloth uses LoRA optimization and Web UI to efficiently fine-tune Gemma 4, Qwen3, DeepSeek and more on consumer GPUs, with 2-5x speed gains and 50-70% VRAM reduction.

Unsloth Tutorial: Fine-Tune LLMs Locally with Multi-fold Speed Boost and 60% VRAM Savings

Tutorials

May 7, 2026·3 min

Unsloth Tutorial: Fine-Tune LLMs Locally with Multi-fold Speed Boost and 60% VRAM Savings

Unsloth is an open-source LLM fine-tuning tool with 63K GitHub stars, supporting Gemma 4, Qwen3, and DeepSeek. It achieves multi-fold training speedup and 60% VRAM reduction through kernel optimization, enabling fine-tuning on consumer GPUs.

Unsloth Tutorial: A Guide to Fine-Tuning LLMs Locally with Reduced VRAM and Faster Training

Tutorials

May 7, 2026·2 min

Unsloth Tutorial: A Guide to Fine-Tuning LLMs Locally with Reduced VRAM and Faster Training

Learn how Unsloth enables efficient local LLM fine-tuning with LoRA optimization, supporting Gemma 4, Qwen3, and DeepSeek while reducing VRAM usage by 50% and boosting training speed 2-5x.

Unsloth: An Efficient Open-Source Tool for Local LLM Fine-Tuning

Product Reviews

May 7, 2026·1 min

Unsloth: An Efficient Open-Source Tool for Local LLM Fine-Tuning

Unsloth is a 63,000+ star open-source project on GitHub with a Web UI for locally training and fine-tuning LLMs like Gemma 4, Qwen3, and DeepSeek on consumer GPUs.