#本地部署
89 related articles
Tech Frontiers·1 min
Qwen3.6 35B Open-Source Model Approaches Claude in Tests, xAI Voice Cloning API Officially Launches
Alibaba open-sources Qwen3.6 35B with 256-expert MoE architecture needing only 3B active params, scoring 73.4% on SWE-Bench near Claude Opus. xAI launches Voice Cloning API supporting 28 languages.
Read more →
Tutorials·2 min
Hermes + Qwen3.6 Local Deployment Tutorial: Build Your Private AI Agent at Zero Cost
Step-by-step tutorial to deploy Hermes Agent with Qwen3.6 open-source LLM locally. Covers WSL setup, model download, Telegram bot integration for a zero-cost private AI Agent.
Read more →
Tutorials·2 min
vLLM and SGLang Local Deployment Tutorial: A Practical Guide to 3-8x Performance Gains
Complete guide to deploying vLLM and SGLang locally. Compare performance vs LM Studio, deploy in 3 steps with Docker + AI assistant. Covers SGLang vs vLLM selection, 5090 VRAM optimization, and Cherry Studio integration.
Read more →
Tech Frontiers·1 min
Wukong 2.2P Open Source: 35B MOE Model Outperforms Qwen3.6-27B at 3–5x the Speed
Wukong 2.2P 35B MOE model is now open source. Using adversarial hybrid distillation, it outperforms Qwen3.6-27B. Runs at 158 tokens/s on RTX 4090 with only 8.9GB VRAM. Supports 256K context.
Read more →
Tech Frontiers·1 min
Qwen3.6 MTP Acceleration Benchmarked: Single GPU Inference Hits 220 token/s
Qwen3.6 experimental MTP-GGUF benchmarked: single GPU pushes 35B-A3B model to 220 token/s, 1.4x faster with zero accuracy loss. Covers MTP principles, optimal Draft Tokens strategy, and RTX 5090 results.
Read more →
Tutorials·2 min
Local Deployment of DeepSeek + RAG Knowledge Base Tutorial: A Step-by-Step Guide with Ollama + RAGFlow
Step-by-step guide to locally deploying DeepSeek with Ollama and building a RAG private knowledge base with RAGFlow. Covers environment setup, Docker deployment, and Embedding principles.
Read more →
Tutorials·1 min
RAGFlow Local Deployment Guide: Complete Tutorial for Building an Enterprise-Grade RAG Knowledge Base with Docker
Complete RAGFlow local deployment guide covering RAG principles, Docker setup, Ollama LLM integration, knowledge base creation, and chat testing. Build an enterprise-grade private knowledge base Q&A system from scratch.
Read more →
Tutorials·1 min
DeepSeek + RAGFlow Local Deployment AI Knowledge Base Tutorial (2025 Latest)
Step-by-step guide to locally deploy a personal AI knowledge base with DeepSeek + RAGFlow + Ollama. Covers RAG principles, Ollama setup, Docker deployment, and knowledge base optimization.
Read more →
Tutorials·2 min
Anima Anime AI Model: Local Deployment with 6GB VRAM & Workflow Configuration Guide
Complete guide to locally deploying the Anima anime AI model with just 6GB VRAM. Covers ComfyUI workflow setup, txt2img parameters, upscaling tips, and low-VRAM optimization for mid-range GPUs.
Read more →
Product Reviews·2 min
Open Design: An Open-Source AI Design Framework That Connects to Your Existing Coding Agents
Open Design is a local-first Apache 2.0 open-source design framework connecting Claude Code, Cursor, Gemini CLI and other coding agents, with 19 composable skills and 71 Design.md systems.
Read more →
Tutorials·2 min
MoS-TTS-Nano Deployment Guide: Ultra-Lightweight 0.1B TTS Model That Runs on CPU
Battle-tested MoS-TTS-Nano local deployment guide. 0.1B ultra-lightweight TTS model runs on quad-core CPU without GPU. Covers Conda setup, pynini installation fixes, model download, and Gradio WebUI.
Read more →
Tech Frontiers·4 min
Step 3.5 Flash Deep Dive: How a 196B Parameter Open-Source Model Beat Gemini
Deep dive into StepFun's Step 3.5 Flash: 196B parameter MoE model activating only 11B, 350 tokens/sec coding speed, 256K context window, local deployment ready. How it beats Gemini 3 Flash.
Read more →
Tutorials·3 min
OpenManus Local Deployment Guide: Real-World Testing with DeepSeek & Troubleshooting Tips
Step-by-step OpenManus local deployment guide covering Conda setup, DeepSeek API config, and Playwright installation. Real-world testing reveals performance, Token costs, and current limitations.
Read more →
Tutorials·4 min
OpenManus Local Deployment Tutorial: DeepSeek Configuration & Real-World Testing Results
Step-by-step OpenManus local deployment guide covering Conda setup, DeepSeek API configuration, and 3 real-world test cases validating AI Agent capabilities including web search and file generation.
Read more →
Product Reviews·3 min
AnythingLLM: A Deep Dive into the All-in-One Local AI Knowledge Base Tool
Deep dive into AnythingLLM, a privacy-first, zero-config local AI productivity platform. Supports RAG document chat, multi-model integration, knowledge bases, and AI Agents with nearly 60K GitHub stars.
Read more →
Product Reviews·4 min
GPT-OSS 120B/20B Open-Source Model In-Depth Review: Comprehensive Testing on Hallucination, Reasoning, and Code
Comprehensive review of OpenAI's open-source GPT-OSS 120B and 20B models covering hallucination testing, logical reasoning, code generation, SQL queries, and document analysis with deployment guides.
Read more →
Tutorials·3 min
OpenAI Open-Sources GPT-OSS: Run O4-Level Models on 16GB VRAM — Complete Deployment Guide
OpenAI open-sources GPT-OSS (20B/120B) with MOE architecture and native FP4 precision. Run O3-level reasoning on a single RTX 4090. Full deployment guide for Ollama, vLLM, and more.
Read more →
Product Reviews·3 min
Sim Studio: Deep Dive into the Open-Source AI Agent Workflow Platform with Nearly 10K Stars
Deep analysis of open-source AI workflow platform Sim Studio with nearly 10K GitHub Stars. Apache 2.0 licensed, supports full local deployment and Ollama local LLM integration. Compared with Dify and n8n.
Read more →
Tutorials·4 min
Codex + Ollama Local Deployment Guide: Build a Free AI Coding Assistant at Zero Cost
Step-by-step guide to deploying Codex with Ollama locally for a free AI coding assistant, covering hardware checks, Ollama setup, model downloads, and full integration configuration.
Read more →
Tutorials·3 min
Ollama + OpenCode Local AI Coding: A Complete Zero-Cost Alternative to Cursor
Tutorial: Deploy Qwen3 Coder locally via Ollama with OpenCode for zero-cost AI coding. Covers setup, code generation, auto-debugging, and hardware recommendations.
Read more →