#LLM deployment
1695 related articles
·3 min
DeepSeek-OCR Deployment & Fine-Tuning in Practice: From vLLM Inference to Unsloth Fine-Tuning
Complete guide to DeepSeek-OCR from vLLM inference deployment and Unsloth model loading to fine-tuning, covering cloud server setup, GPU selection, and code examples — all on a single 4090 GPU.
Read more →
·2 min
vLLM Inference Framework Deep Dive: A Practical Guide to High-Concurrency DeepSeek Deployment
A deep dive into vLLM's five core features — KV cache management, continuous batching, and distributed inference — plus a full setup guide for deploying DeepSeek on a cloud server.
Read more →
Java Local LLM Inference: Low-Latency …
·2 min
Java Local LLM Inference: Low-Latency LLM Deployment with Panama FFM
Learn how Java and OpenJDK Panama FFM API enable local LLM inference. Explore the technical foundations, JVM ecosystem benefits, and low-latency AI deployment in enterprise Java systems.
Read more →
·2 min
Production LLM Deployment Guide: Model Selection, GPU Configuration, and Inference Engine Breakdown
A comprehensive decision framework for production LLM deployment: model selection (open-source vs. API), GPU VRAM configuration, and inference engine comparison including vLLM and TensorRT-LLM.
Read more →
·5 min
Real-World Comparison of 6 Open-Source LLMs for On-Premise Deployment: A Selection Guide to Avoid Pitfalls
A hands-on comparison of 6 open-source LLMs (DeepSeek, Qwen3, Zhipu GLM, Kimi K2, MiniMax M3, Tencent Hunyuan 3) for on-premise deployment—covering hardware cost, inference efficiency, and deployment difficulty.
Read more →
The Complete Guide to Local LLM Deploy…
·2 min
The Complete Guide to Local LLM Deployment: Tools, Hardware, and Model Selection
A complete guide to locally deploying open-source LLMs: covering VRAM requirements, quantization, tools like Ollama and LM Studio, and model selection tips for Llama, Qwen, and more.
Read more →
·6 min
LangChain + MCP in Practice: A Pitfall-Avoidance Guide to LLM Selection and Local Deployment
DeepSeek R1 lacks Function Calling and JSON Output by default. Qwen3's programmable thinking modes make it the top open-source agent choice. Key LLM selection pitfalls and MCP protocol updates.
Read more →
·2 min
Getting Started with Ollama: The Go-To Tool for Free Local LLM Deployment
Ollama is a free, open-source LLM management tool supporting macOS, Windows, Linux, and Docker. Deploy DeepSeek and other open-source models locally — no API fees, full data privacy.
Read more →
·4 min
Llama.cpp Windows Local Deployment Guide: Run LLMs in Three Steps Without Compiling
Step-by-step guide to deploying Llama.cpp on Windows without compiling. Download pre-built packages, configure CUDA, and run GGUF quantized models locally with GPU acceleration and web UI in three simple steps.
Read more →
·3 min
Claude Code with Local LLMs: Token-Free Deployment Guide & Configuration
Learn how to connect Claude Code to local LLMs for token-free AI coding. Covers three-layer architecture, Ollama/LM Studio/vLLM setup, protocol translation, and hardware selection.
Read more →
·3 min
Claude Code Local Deployment: A Practical Guide to Connecting Local LLMs
Complete guide to deploying Claude Code locally with Ollama, LM Studio, or vLLM. Covers architecture, protocol translation, hardware requirements, and model selection for zero-cost, private AI coding.
Read more →
Tutorials·2 min
Ollama Local LLM Deployment: From Installation to Conversation in Three Steps
Learn how to deploy LLMs locally with Ollama in three simple steps: install, choose a model, and run. No coding required, supports offline use, and completely free.
Read more →
Product Reviews·3 min
Hertzman: A Free, No-Install Local LLM Deployment Tool Review
Detailed review of Hertzman local inference engine covering one-click deployment, smart hardware recommendations, OpenAI-compatible API, and performance comparison with LM Studio.
Read more →
Product Reviews·2 min
AI Coding Appliance vs Cloud LLMs: Can ¥480K in Annual Fees Buy 4 Local Deployment Solutions?
A deep cost comparison between AI coding appliances and cloud LLM APIs. A 20-person team spending ¥480K/year on tokens can deploy 4 local OnePanel units at ¥99K each, breaking even in 2.5 months.
Read more →
Tutorials·2 min
Complete Guide to Local LLM Deployment with Ollama: AI That Works Offline
Complete guide to deploying open-source LLMs locally with Ollama. Covers installation, model selection, VRAM requirements, and performance comparison of Llama 3 and Qwen models. Free, offline-capable AI.
Read more →
Tutorials·1 min
Ollama Local LLM Deployment Tutorial: Complete Guide from Installation to API Integration
Complete guide to deploying open-source LLMs locally with Ollama, covering installation, model selection, quantization strategies, Python API integration, and performance optimization tips.
Read more →
Product Reviews·5 min
AnythingLLM Review: The Complete Guide to Local Deployment of This Open-Source AI Knowledge Base Platform
In-depth review of AnythingLLM open-source AI platform: local deployment, RAG document Q&A, multi-model switching, and more. How does this 59K+ star GitHub project deliver privacy-first AI? Includes comparison with PrivateGPT and Open WebUI.
Read more →
Tutorials·2 min
Ollama Local LLM Deployment Guide: The 170K-Star Open Source Tool That Runs DeepSeek, Qwen, Kimi, and More
Ollama is a 170K-star open source tool for local LLM deployment. Run DeepSeek, Qwen, Kimi-K2.5, GLM-5 and more with one command. Learn its advantages and setup.
Read more →
·2 min
Agenta: A Detailed Look at the Open-Source Self-Hosted Claude Cowork Alternative
Agenta is an open-source AI Agent collaboration platform supporting self-hosted models and any Agent framework, positioned as an open-source Claude Cowork alternative.
Read more →
·2 min
Grok 4.6 and 4.7 Roadmap Leaked: Analyzing xAI's Rapid Iteration Strategy
Reddit leaks suggest Grok 4.6 arrives around August 7 and Grok 4.7 in early September. This article analyzes xAI's rapid iteration strategy and token efficiency improvements.
Read more →