#quantized model deployment
330 related articles
·3 min
NVIDIA XR AI Platform Explained: Full-Stack AI Agent Development for AR Glasses
Deep dive into how NVIDIA's XR AI platform enables AI Agent development for AR glasses through cloud-edge architecture, covering visual perception, voice interaction, and multimodal reasoning.
Read more →
·2 min
Nex N2 Pro In-Depth Review: How Does This Chinese Open-Source Agent Model Really Perform?
In-depth review of Nex N2 Pro, a Chinese open-source Agent model. Covers frontend code generation, Agent workflows, and benchmark comparisons, revealing gaps between official claims and independent tests.
Read more →
·4 min
Is the 748-Episode AI Large Language Model Tutorial on Bilibili Worth Watching? A Full Breakdown of Content Structure and Study Tips
In-depth analysis of Bilibili's 748-episode AI LLM tutorial covering RAG, Agent, and fine-tuning. Includes content structure breakdown and practical study tips for beginners.
Read more →
·3 min
OpenLLMVTuber: A Deep Dive into the Open-Source AI Virtual Character Framework
Deep dive into OpenLLMVTuber, a 10K-star open-source AI virtual character framework integrating ASR, LLM, TTS, and Live2D with voice interruption, visual perception, and modular architecture.
Read more →
·3 min
Claude Code Desktop Hands-On: Transparent Context Window & CC Switch for Compute Freedom
Hands-on review of Claude Code Desktop's transparent context window, multi-project heatmap, efficiency panel, and CC Switch open-source routing gateway for model freedom.
Read more →
·3 min
Claude Fable 5 Global Ban: Deep Analysis of the AI Economic Chain Fracture Crisis
Claude Fable 5 banned globally just 3 days after launch. Deep analysis of the jailbreak controversy, AI supply chain fracture risk, Anthropic's fear marketing backfire, and local AI deployment strategies.
Read more →
·4 min
Llama.cpp Windows Local Deployment Guide: Run LLMs in Three Steps Without Compiling
Step-by-step guide to deploying Llama.cpp on Windows without compiling. Download pre-built packages, configure CUDA, and run GGUF quantized models locally with GPU acceleration and web UI in three simple steps.
Read more →
·3 min
ThundeRobot Hunter Blade S 2026 Review: i9-13900HX + RTX 5060 Configuration Analysis & Buying Guide
In-depth review of the ThundeRobot Hunter Blade S 2026 with i9-13900HX and RTX 5060 16GB. Analyzing CPU/GPU performance, AI capabilities, and value at ~6,671 RMB after subsidies.
Read more →
·3 min
Fireworks AI Launches Qwen 3.7 Plus: Zero Data Retention and 99.9% SLA for Enterprise Deployment
Fireworks AI launches Qwen 3.7 Plus with latency/throughput optimization, zero data retention, and 99.9% SLA enterprise guarantees. Explore the full-stack deployment solution for commercial open-source model inference.
Read more →
·4 min
Local Deployment of Claude Code: Principles and Practical Guide for Three Approaches
A detailed guide to locally deploying Claude Code with three approaches (LM Studio, Ollama, vLLM), covering architecture, protocol translation, hardware selection, and model recommendations.
Read more →
·3 min
Deploying a Multimodal AI Agent Locally on a 3080Ti: VRAM Management and a Deep Dive into All Five Modules
A detailed guide to deploying a multimodal AI Agent on a 3080Ti with 12GB VRAM, covering LLM, STT, TTS, image and video generation module selection, dynamic VRAM loading, and real-world performance.
Read more →
·3 min
5 Ways to Deploy LLMs Locally: From Getting Started to Production
A complete guide to 5 local LLM deployment methods: LlamaCPP, Ollama, LM Studio, vLLM/SGLang, and MLX-LM — from personal dev to production environments.
Read more →
·4 min
AI Agent Development: A Complete 6-Week Systematic Learning Roadmap
A 6-week systematic learning roadmap for AI Agent development, covering core architecture, ReAct principles, multi-agent collaboration, RAG integration, and deployment.
Read more →
·3 min
Gemma 4 Open-Source Model Local Deployment Guide: Ollama Installation & Mobile Setup
Step-by-step guide to deploying Google's Gemma 4 open-source model locally with Ollama and running the lightweight version on mobile with tool calling support.
Read more →
·3 min
Claude Code with Local LLMs: Token-Free Deployment Guide & Configuration
Learn how to connect Claude Code to local LLMs for token-free AI coding. Covers three-layer architecture, Ollama/LM Studio/vLLM setup, protocol translation, and hardware selection.
Read more →
·2 min
Nex N2 Pro Real-World Testing: Top 5 on Official Benchmarks, Only 12th in Independent Tests
Deep-dive testing of Nex N2 Pro open-source Agent model comparing official benchmarks vs independent results. The 397B parameter model shows decent frontend generation but ranks 12th independently, not top 5 as claimed.
Read more →
·2 min
A Complete Guide to LLM Infrastructure: Core Challenges from GPU Clusters to Inference Optimization
A deep dive into core challenges and key technologies for LLM infrastructure, covering GPU cluster management, inference optimization, distributed training, cost control, and observability.
Read more →
·2 min
Connecting Cursor to Third-Party APIs for the Latest Models? An In-Depth Analysis of Risks and Alternatives
Analyzing the risks of using third-party API proxies in Cursor for GPT-5.5 and Claude Opus 4, covering data security, stability, and ban risks, plus safer alternatives.
Read more →
·4 min
AI Engineer Job Search: The Capability Leap from Demo to Production System
AI job demand is surging but companies can't find qualified candidates. Learn the 3 core skills—advanced RAG, local model deployment, and full-stack monitoring—to leap from demo builder to production engineer.
Read more →
·3 min
CC Switch Tutorial: Connect Claude Code to Domestic Chinese LLMs Without a VPN
Step-by-step tutorial on using CC Switch to connect Claude Code to DeepSeek, Kimi, and other Chinese LLMs without a VPN or Claude account for low-cost AI coding.
Read more →