#open source LLM local deployment
821 related articles
Product Reviews·5 min
AnythingLLM Review: The Complete Guide to Local Deployment of This Open-Source AI Knowledge Base Platform
In-depth review of AnythingLLM open-source AI platform: local deployment, RAG document Q&A, multi-model switching, and more. How does this 59K+ star GitHub project deliver privacy-first AI? Includes comparison with PrivateGPT and Open WebUI.
Read more →
Tutorials·2 min
Ollama Local LLM Deployment Guide: The 170K-Star Open Source Tool That Runs DeepSeek, Qwen, Kimi, and More
Ollama is a 170K-star open source tool for local LLM deployment. Run DeepSeek, Qwen, Kimi-K2.5, GLM-5 and more with one command. Learn its advantages and setup.
Read more →
·3 min
Claude Code vs Codex: Hands-On Comparison and Installation Guide for AI Programming Tools
In-depth comparison of Claude Code and Codex AI programming tools covering accuracy, installation, and network setup tips to help developers choose the best solution.
Read more →
·3 min
Comparing Ways for Users in China to Access ChatGPT: Are Mirror Platforms Reliable?
An in-depth analysis of the barriers Chinese users face accessing ChatGPT, an honest assessment of third-party mirror platforms' risks, and safer alternatives including official APIs and domestic LLMs.
Read more →
·5 min
Learn AI Agent Development from Scratch: A 3-Step Practical Path to Get Started Quickly
How to learn AI Agent development from scratch? This article outlines a clear 3-step path: Python crash course, LLM theory & practice, and LangChain framework project implementation.
Read more →
·3 min
Spring AI Explained: Unified API, RAG, and Enterprise AI Development Practical Guide
Deep dive into Spring AI framework's core features including provider-agnostic unified API abstraction, RAG retrieval-augmented generation, and structured output to help Java developers build enterprise AI apps.
Read more →
·3 min
Spring AI Explained: Unified API, RAG, and Enterprise AI Development Guide
Deep dive into Spring AI framework's core features including provider-agnostic unified API abstraction, RAG retrieval-augmented generation, and structured output to help Java developers build enterprise AI apps.
Read more →
·4 min
Spring AI 2.0 in Practice: Building an Enterprise RAG Knowledge Base Q&A System with Cursor
Build an enterprise RAG knowledge base Q&A system using Spring AI 2.0, Cursor AI programming, Ollama local deployment, and Redis vector storage. Runs on just 4GB VRAM.
Read more →
·3 min
Kimi K3 Deep Dive: How a 3 Trillion Parameter Open-Weight Model Reaches the Frontier
Deep dive into Kimi K3: the largest open-weight model at 3 trillion parameters, surpassing Opus-level models in Agentic coding with 896-expert MoE architecture, 1M token context, at Sonnet pricing.
Read more →
·4 min
Colibri: Running a 744-Billion-Parameter LLM on an Ordinary Laptop
Colibri uses MoE hot-cold separation and 4-bit quantization to run 744B-parameter models like GLM 5.2 on consumer hardware. Learn about its three-tier memory architecture and speculative decoding.
Read more →
·4 min
Laguna S 2.1 Deep Dive: Hands-On Local Deployment of a 118B Parameter Coding Model
In-depth review of Poolside's Laguna S 2.1 open-source coding model: MoE architecture, RL training, DGX Spark local deployment, and real-world agentic coding tests with 8B active parameters.
Read more →
·4 min
Kimi K3 Deep Dive: 2.8 Trillion Parameter Open-Source Model Closes the Gap with Closed-Source Frontier for the First Time
Moonshot AI releases Kimi K3 open-weight model with 2.8T parameters and 1M token context. Our deep dive covers coding, 3D dev, agent capabilities, and safety concerns.
Read more →
·3 min
Apple Silicon LLM Inference Speed Benchmarks: A Complete Guide to Local Large Model Performance on Mac
In-depth analysis of Apple Silicon local LLM inference speed benchmarks covering M-series memory bandwidth, model quantization, MLX framework optimization, and Mac configuration guidance.
Read more →
·4 min
Getting Started with AI Agent Development: A Complete Guide from Concept to Practice
A comprehensive guide to AI Agent architecture and development, covering automated marketing, intelligent customer service, and investment analysis scenarios with single and multi-agent collaboration.
Read more →
·3 min
Poolside Laguna Model Launch: Can Silicon Valley's Open-Source Push Catch Up to China's AI?
Poolside launches Laguna open-weight model after 18 months of silence, pitting 118B parameters against Kimi K3's 2.8 trillion. Can Silicon Valley's open-source push close the gap with Chinese AI?
Read more →
·3 min
Cursor Alternatives Compared: A Guide to 5 AI Coding Tools
Compare 5 Cursor alternatives — from GitHub Copilot and Windsurf to open-source Cline and Continue — covering model freedom, workflow integration, cost, and privacy.
Read more →
·3 min
Kimi K3 Launches on Ollama Cloud: Free Tier, User Experience, and Developer Guide
Kimi K3 officially launches on Ollama Cloud as an "extra high usage" model. This guide covers free tier quotas, cloud inference experience, technical advantages, and how developers can seamlessly call this high-performance LLM.
Read more →
·3 min
Ollama's Extra Charges for Kimi 3 Spark Community Controversy: Should Open-Source Models Be Free to Use?
Ollama lists Kimi 3 with extra pay-per-use fees, breaking subscription expectations and sparking debate over open-weight models and AI service pricing tiers.
Read more →
·4 min
AI Agent Development in Practice: A Complete Path from Zero to Production
A systematic guide to AI Agent development covering core modules, framework selection, tool calling, data preparation, and production deployment to help developers build production-ready Agent applications.
Read more →
·3 min
Agent Skills Explained: Solving the MCP Context Bloat Problem
Deep dive into Anthropic's Agent Skills mechanism, explaining how Progressive Disclosure solves MCP context bloat and tool calling accuracy issues in AI agents.
Read more →