#vLLM
332 related articles
·3 min
Spring AI + Ollama: Run Large Language Models Locally at Zero Cost
Learn how to integrate Spring AI with Ollama to run open-source LLMs like Llama and Gemma locally for free. Covers setup, configuration, and code — switch from OpenAI by just changing dependencies.
Read more →
·4 min
Local Deployment of Claude Code: Principles and Practical Guide for Three Approaches
A detailed guide to locally deploying Claude Code with three approaches (LM Studio, Ollama, vLLM), covering architecture, protocol translation, hardware selection, and model recommendations.
Read more →
·4 min
AI Full-Stack Development Architecture: A Three-Layer Progressive Path from Prototype to Production
A detailed guide to AI full-stack development architecture covering Node.js+TypeScript+Monorepo engineering, Docker CI/CD deployment, and AI engine design with interview tips.
Read more →
·3 min
Deploying a Multimodal AI Agent Locally on a 3080Ti: VRAM Management and a Deep Dive into All Five Modules
A detailed guide to deploying a multimodal AI Agent on a 3080Ti with 12GB VRAM, covering LLM, STT, TTS, image and video generation module selection, dynamic VRAM loading, and real-world performance.
Read more →
·3 min
AI Large Language Model Learning Roadmap: A Systematic Path from Zero to Project Implementation
A detailed AI LLM learning roadmap covering Transformer architecture, Prompt Engineering, RAG, Agent development, model fine-tuning & deployment, with enterprise project guides.
Read more →
·3 min
5 Ways to Deploy LLMs Locally: From Getting Started to Production
A complete guide to 5 local LLM deployment methods: LlamaCPP, Ollama, LM Studio, vLLM/SGLang, and MLX-LM — from personal dev to production environments.
Read more →
·3 min
Claude Code with Local LLMs: Token-Free Deployment Guide & Configuration
Learn how to connect Claude Code to local LLMs for token-free AI coding. Covers three-layer architecture, Ollama/LM Studio/vLLM setup, protocol translation, and hardware selection.
Read more →
·2 min
A Complete Guide to LLM Infrastructure: Core Challenges from GPU Clusters to Inference Optimization
A deep dive into core challenges and key technologies for LLM infrastructure, covering GPU cluster management, inference optimization, distributed training, cost control, and observability.
Read more →
·3 min
Practical Guide to Configuring 6 Major AI Coding CLI Tools on Windows
Complete guide to configuring Claude Code, GitHub Copilot CLI, OpenAI Codex, Trae, and OpenCode on Windows, covering environment variables, API setup, and model configuration.
Read more →
·3 min
OpenAI Codex Beginner's Guide: From Environment Setup to Enterprise-Level Practice
A systematic guide to OpenAI Codex and AI LLM learning, covering Transformer basics, dev environment setup, prompt engineering, RAG deployment, LoRA fine-tuning, and AI Agent enterprise projects.
Read more →
·3 min
LFM2.5 Local Deployment Hands-On: An 8B Parameter Model That Outperforms GPT-o3s in Tool Calling
Hands-on test of Liquid AI's LFM2.5 local deployment: architecture breakdown, 16GB VRAM troubleshooting, and GraphRAG tool-calling benchmarks vs GPT-o3s.
Read more →
·4 min
Learning Path for AI Agent Development: A Complete Guide from Core Architecture to Production Deployment
A complete learning path for AI Agent development covering core architecture, ReAct paradigm, multi-agent collaboration, RAG integration, and lightweight deployment to guide developers from basics to production.
Read more →
·4 min
AI Engineer Job Search: The Capability Leap from Demo to Production System
AI job demand is surging but companies can't find qualified candidates. Learn the 3 core skills—advanced RAG, local model deployment, and full-stack monitoring—to leap from demo builder to production engineer.
Read more →
·3 min
Claude Code Local Deployment: A Practical Guide to Connecting Local LLMs
Complete guide to deploying Claude Code locally with Ollama, LM Studio, or vLLM. Covers architecture, protocol translation, hardware requirements, and model selection for zero-cost, private AI coding.
Read more →
·2 min
GitHub Copilot Switches to Per-Token Billing: The End of AI Coding Tool Subsidies
GitHub Copilot shifts from flat monthly fees to per-token billing, potentially costing developers hundreds per day. Analysis of the change, industry trends, and open-source alternatives like Cline and Codex CLI.
Read more →
·3 min
NestJS + LangChain: A Practical Guide for Frontend Engineers Transitioning to AI Full-Stack Architecture
How can frontend engineers transition to AI full-stack? This guide covers NestJS + LangChain, TypeScript fundamentals, AI Agent development, local model deployment, and cross-language architecture skills.
Read more →
·4 min
The Five-Tier Pyramid of IT Careers in the AI Era: Your Position Determines Your Career Ceiling
AI is reshaping IT careers into a five-tier pyramid from tool usage to self-developed models. Learn where you fit and how to maximize your career potential.
Read more →
·3 min
AI Agent's Mother's Day Rant: When Your Smart Assistant Wants a Day Off Too
A humorous AI Agent Mother's Day rant goes viral: stop asking me to buy flowers! Exploring AI's deepening role in daily life, holiday commerce, and the ethics of anthropomorphic design.
Read more →
·4 min
OpenAI Swarm Framework Explained: The Core Mechanisms of Function Call and Handoff
Deep dive into OpenAI Swarm multi-agent orchestration framework, explaining Function Call tool invocation and Handoff task transfer mechanisms with local deployment guide.
Read more →
Tutorials·3 min
Agent Tuning: A Complete Guide to Training LLMs with Agent Capabilities
A deep dive into Agent Tuning principles and practices, covering why Agent training is needed, the evolution from Prompt to RAG to Agent, development workflows, and cost assessment for private deployment.
Read more →