#quantization GGUF
305 related articles
·3 min
Spring AI + Ollama: Run Large Language Models Locally at Zero Cost
Learn how to integrate Spring AI with Ollama to run open-source LLMs like Llama and Gemma locally for free. Covers setup, configuration, and code — switch from OpenAI by just changing dependencies.
Read more →
·3 min
ThundeRobot Hunter Blade S 2026 Review: i9-13900HX + RTX 5060 Configuration Analysis & Buying Guide
In-depth review of the ThundeRobot Hunter Blade S 2026 with i9-13900HX and RTX 5060 16GB. Analyzing CPU/GPU performance, AI capabilities, and value at ~6,671 RMB after subsidies.
Read more →
·4 min
Local Deployment of Claude Code: Principles and Practical Guide for Three Approaches
A detailed guide to locally deploying Claude Code with three approaches (LM Studio, Ollama, vLLM), covering architecture, protocol translation, hardware selection, and model recommendations.
Read more →
·3 min
Deploying a Multimodal AI Agent Locally on a 3080Ti: VRAM Management and a Deep Dive into All Five Modules
A detailed guide to deploying a multimodal AI Agent on a 3080Ti with 12GB VRAM, covering LLM, STT, TTS, image and video generation module selection, dynamic VRAM loading, and real-world performance.
Read more →
·3 min
5 Ways to Deploy LLMs Locally: From Getting Started to Production
A complete guide to 5 local LLM deployment methods: LlamaCPP, Ollama, LM Studio, vLLM/SGLang, and MLX-LM — from personal dev to production environments.
Read more →
·1 min
Gemma 4 12B: Google's Open-Weight Model Runs Locally on Your Laptop
Google releases Gemma 4 12B, an open-weight model that runs locally on laptops. Learn about its performance, local deployment value, and the open-source LLM competitive landscape.
Read more →
·3 min
Gemma 4 Open-Source Model Local Deployment Guide: Ollama Installation & Mobile Setup
Step-by-step guide to deploying Google's Gemma 4 open-source model locally with Ollama and running the lightweight version on mobile with tool calling support.
Read more →
·3 min
Claude Code with Local LLMs: Token-Free Deployment Guide & Configuration
Learn how to connect Claude Code to local LLMs for token-free AI coding. Covers three-layer architecture, Ollama/LM Studio/vLLM setup, protocol translation, and hardware selection.
Read more →
·4 min
AI Engineer Job Search: The Capability Leap from Demo to Production System
AI job demand is surging but companies can't find qualified candidates. Learn the 3 core skills—advanced RAG, local model deployment, and full-stack monitoring—to leap from demo builder to production engineer.
Read more →
·3 min
Claude Code Local Deployment: A Practical Guide to Connecting Local LLMs
Complete guide to deploying Claude Code locally with Ollama, LM Studio, or vLLM. Covers architecture, protocol translation, hardware requirements, and model selection for zero-cost, private AI coding.
Read more →
·4 min
AI Agent in Practice: Building a Commercial-Grade Programming Agent from Scratch
A deep dive into AI Agent development, from the core principles of perception-decision-action to a Vue3 auto-creation demo, covering LangChain, LangGraph, MCP, and the full tech stack.
Read more →
·5 min
CherryStudio + MCP: Tutorial for Building Automated AI Agents and Local Knowledge Bases
Complete guide to building automated AI agents with Cherry Studio and MCP protocol, covering environment setup, MCP Server configuration, web scraping, Shell execution, and Ollama local knowledge base deployment.
Read more →
Deep Dives·3 min
Complete Guide to LLM Training: Pre-training, SFT Fine-tuning, and Preference Alignment Explained
Complete guide to the three core LLM training stages: pre-training, supervised fine-tuning (SFT), and preference alignment (DPO/PPO), covering LoRA, distillation, quantization, and pruning.
Read more →
Tutorials·3 min
OpenClaw Local Deployment Tutorial: Connect to WeChat, Feishu & DingTalk in 10 Minutes
Complete guide to deploying OpenClaw locally, covering Windows setup, cloud deployment, WeChat/Feishu/DingTalk integration, and custom Skills—beginners can deploy in 10 minutes.
Read more →
Tech Frontiers·2 min
DeepSeek-V3.2 Released: Coding and Math Capabilities Join the Global Top Tier
DeepSeek-V3.2 released with coding, math, and Agent capabilities matching Gemini 3.0 Pro, setting new open-source SOTA. Detailed analysis of performance gains, use cases, and deployment tips.
Read more →
Product Reviews·3 min
Google Gemma 4 Hands-On Review: Offline on Smartphones + Ollama Deployment Tutorial
Hands-on testing of Google Gemma 4 open-source models running offline on three phones, with Dense vs MOE architecture explained and a complete Ollama + Claude Code deployment tutorial.
Read more →
Product Reviews·3 min
WhichLLM: One Command to Find the Best Local LLM for Your Hardware
WhichLLM is an open-source tool that auto-detects your hardware and recommends the best local LLM using real benchmark data. Simulate GPUs, filter fake benchmarks, and start chatting in one command.
Read more →
Tutorials·3 min
One Person, Three Machines: Local Agent Deployment and Multi-Machine Collaborative Operations in Practice
Deploy Cloud Code and Hermes AI Agents to efficiently manage three physical hosts solo. Covers Ventoy single-file deployment, BTRFS+RAW Image setup, Agent task division, and risk control strategies.
Read more →
Tutorials·3 min
llama.cpp MTP Acceleration Deployment Guide: Configuration Steps & Real-World Benchmarks
Guide to enabling MTP multi-Token prediction acceleration in llama.cpp, covering CUDA setup, desktop configuration, model selection, and benchmarks showing ~60 Token/s with Qwen3 27B.
Read more →
Tutorials·3 min
Frontend AI Full-Stack Development in Practice: Building Multimodal Applications with PNPM MonoRepo Architecture
A practical guide to frontend AI full-stack development covering PNPM MonoRepo architecture, TurboRepo build optimization, and LangChain multimodal applications with Ollama local model deployment.
Read more →