#inference engine
3172 related articles
Product Reviews·3 min
Tianshu: Open-Source AI Document Parsing Platform — A One-Stop Solution for PDF to Markdown Conversion
Tianshu (mineru-tianshu) is an enterprise-grade open-source AI document preprocessing platform supporting PDF/Office to Markdown conversion, MCP protocol AI assistant integration, with a Vue3+FastAPI full-stack architecture for RAG systems and enterprise knowledge bases.
Read more →
Tutorials·4 min
Ollama Tutorial: Run DeepSeek and Other LLMs Locally with a Single Command
Complete guide to running LLMs locally with Ollama. Supports DeepSeek, Qwen, Gemma and more. Learn installation, architecture, and use cases—zero API costs with full data privacy.
Read more →
Product Reviews·5 min
Hugging Face Transformers: Deep Dive into the 160K-Star Open Source Framework
Deep dive into Hugging Face Transformers, covering core features, API design, model ecosystem, and practical code examples. Learn how this 160K-Star project lowers AI barriers and drives democratization across LLMs, computer vision, and multimodal AI.
Read more →
Tutorials·3 min
ComfyUI LoRA Training Tutorial: TrainTools-MZ Plugin Turns Model Training into Node-Based Visual Workflow
ComfyUI-TrainTools-MZ is a ComfyUI training node plugin based on kohya-ss/sd-scripts, enabling LoRA fine-tuning directly in the node editor. This guide covers installation, configuration, and usage.
Read more →
Deep Dives·3 min
Ruflo Open-Source Framework: Claude Multi-Agent Orchestration Platform Architecture and Practical Guide
Deep analysis of Ruflo open-source multi-agent orchestration platform, covering swarm intelligence, RAG integration, Claude Code native support, and comparisons with LangGraph and CrewAI.
Read more →
Product Reviews·4 min
Chatbox Open-Source AI Client: The Power Behind 40K Stars and a Complete Usage Guide
Deep dive into Chatbox, an open-source AI desktop client with nearly 40K GitHub Stars. Supports multi-model switching via API (OpenAI, Claude, etc.) with local data storage for privacy-conscious users.
Read more →
Product Reviews·3 min
Chatbox: An Open-Source AI Client with Nearly 40K GitHub Stars, Supporting Unified Multi-Model Management
Deep dive into Chatbox, an open-source AI client with ~40K GitHub Stars. Supports GPT, Claude, Ollama multi-model management with local data storage for privacy across Windows/macOS/Linux.
Read more →
Product Reviews·3 min
8K Stars on GitHub: Deep Dive into the Most Comprehensive LLM Learning Resource Repository
Deep dive into the GitHub project awesome-LLM-resources (8200+ stars): a comprehensive guide covering multimodal AI, AI Agents, MCP protocol, model training, inference optimization, and small language models.
Read more →
Product Reviews·5 min
DeepSeek API Integration Ecosystem: A Complete Analysis of the 37K-Star Open Source Project
Analysis of the 37K-Star awesome-deepseek-integration project on GitHub, covering DeepSeek API integrations for VS Code, browsers, Obsidian, and more, with quick-start guides for developers.
Read more →
Product Reviews·5 min
AnythingLLM: Open-Source AI Knowledge Base with 60K Stars, Local Deployment with Privacy First
AnythingLLM is an open-source AI knowledge base tool with nearly 60K GitHub Stars. It supports local deployment, RAG, multi-model switching, and document parsing with zero-config setup, offering privacy-first AI productivity for enterprises and individuals.
Read more →
Product Reviews·3 min
Cube Studio Deep Dive: Tencent's Open-Source Cloud-Native AI Platform — A Complete MLOps Workflow Guide
Deep dive into Cube Studio, Tencent Music's open-source cloud-native AI platform covering distributed training, LLM SFT/RLHF fine-tuning, vLLM inference, VGPU virtualization, and domestic chip adaptation for complete MLOps workflows.
Read more →
Tutorials·5 min
Codex CLI /goal Command Explained: Autonomous Loop Execution Until Goal Completion
Codex CLI 0.128.0 adds the /goal command for goal-driven autonomous loop execution. This article analyzes its technical implementation, token budget mechanism, and practical use cases.
Read more →
Product Reviews·3 min
Anything Analyzer: An All-in-One Protocol Analysis Tool Integrating Packet Capture, MITM Proxy, and AI Analysis
Deep dive into Anything Analyzer: an open-source tool integrating browser packet capture, MITM proxy, JS Hook, fingerprint spoofing, AI analysis, and MCP Server for protocol analysis and security research.
Read more →
Product Reviews·2 min
The Complete DeepSeek API Integration Ecosystem: Deep Dive into a 37,000+ Star Open Source Project
Deep analysis of DeepSeek's awesome-deepseek-integration with 37,000+ Stars: integration ecosystem, core value, developer onboarding guide, and future trends for connecting DeepSeek API to mainstream workflows.
Read more →
Product Reviews·4 min
Cube Studio Deep Dive: A Practical Guide to Tencent's Open-Source One-Stop MLOps Platform
Deep dive into Tencent's open-source Cube Studio: architecture, large model training/fine-tuning, vLLM inference, distributed training ecosystem, Ascend adaptation, and VGPU compute management for enterprise MLOps.
Read more →
Product Reviews·3 min
UnrealGenAISupport: An In-Depth Analysis of the All-in-One AI Integration Plugin for UE5
In-depth analysis of UnrealGenAISupport, an open-source UE5 plugin integrating GPT-5, Claude, Gemini and dozens of AI models with built-in MCP server for editor control, enabling intelligent NPCs, 3D asset generation, and AI Agent workflows.
Read more →
Deep Dives·3 min
Langflow Deep Dive: The AI Workflow Visual Builder with 140K+ GitHub Stars
Deep dive into Langflow, the open-source AI workflow builder with 147K GitHub Stars. Explore its drag-and-drop visual editor, LangChain integration, RAG building capabilities, and low-code AI development features.
Read more →
Product Reviews·4 min
Unsloth: The Efficient Tool for Local Open-Source LLM Training — The Secret Behind 60K+ GitHub Stars
In-depth analysis of Unsloth, a 60K+ star open-source LLM training tool supporting Gemma 4, Qwen3, DeepSeek local fine-tuning with LoRA/QLoRA to dramatically reduce VRAM requirements.
Read more →
Tutorials·5 min
Ollama Tutorial: One-Click Local Deployment of DeepSeek and Other LLMs
Ollama is an open-source tool with 170K+ GitHub Stars for running DeepSeek, Qwen, Gemma and other LLMs locally. Learn installation, supported models, use cases and core advantages.
Read more →
Product Reviews·3 min
The Complete Guide to AnythingLLM: A Privacy-First AI Knowledge Base Tool for Local Deployment
Deep dive into AnythingLLM, an open-source AI tool with 59K+ GitHub Stars. Supports local LLM inference, RAG private knowledge base Q&A, and zero-config setup. Explore core features, use cases, and architecture.
Read more →