#inference optimization
1718 related articles
Deep Dives·4 min
Hugging Face Transformers Deep Dive: Why This 160K-Star AI Open-Source Framework Has Become the Industry Standard
Deep dive into Hugging Face Transformers: core architecture, full-modality support, inference/training capabilities, and community ecosystem. Learn how this 160K-star project became the industry's AI infrastructure.
Read more →
Product Reviews·4 min
Unsloth: The Open-Source Tool That Makes Local LLM Fine-Tuning 5x Faster
Unsloth is an open-source LLM fine-tuning tool with 63K+ GitHub stars. Supporting Gemma 4, Qwen 3, and DeepSeek, it boosts training speed 2-5x and cuts VRAM by 80% via LoRA/QLoRA, with a Web UI for easy local fine-tuning.
Read more →
Product Reviews·5 min
Unsloth: The Open-Source Tool That Speeds Up Local LLM Fine-Tuning by 5x
Unsloth is an open-source LLM training tool with 63,000+ GitHub Stars. It supports local fine-tuning of Gemma 4, Qwen3, DeepSeek and more, with Web UI, VRAM optimization, and 2-5x training speedup on consumer GPUs.
Read more →
Tutorials·5 min
Google Open-Sources Full-Stack AI Agent Tutorial: Gemini 2.5 + LangGraph Deep Dive
Google open-sources gemini-fullstack-langgraph-quickstart with 18,000+ Stars. Deep dive into the technical architecture, state machine design patterns, and tool-calling mechanisms of building full-stack AI Agents with Gemini 2.5 and LangGraph.
Read more →
Product Reviews·3 min
NetCoreKevin: An Open-Source .NET Enterprise AI Knowledge Base Agent Architecture in Practice
Deep dive into NetCoreKevin, an open-source .NET project integrating Semantic Kernel and RAG for AI knowledge base agents, with multi-tenant SaaS, MCP protocol, and distributed transaction support.
Read more →
Product Reviews·5 min
Hugging Face Transformers: Deep Dive into the 160K-Star Open Source Framework
Deep dive into Hugging Face Transformers, covering core features, API design, model ecosystem, and practical code examples. Learn how this 160K-Star project lowers AI barriers and drives democratization across LLMs, computer vision, and multimodal AI.
Read more →
Deep Dives·3 min
Ruflo Open-Source Framework: Claude Multi-Agent Orchestration Platform Architecture and Practical Guide
Deep analysis of Ruflo open-source multi-agent orchestration platform, covering swarm intelligence, RAG integration, Claude Code native support, and comparisons with LangGraph and CrewAI.
Read more →
Product Reviews·2 min
DiffSynth-Studio: A Complete Guide to the Open-Source Diffusion Model Tool with 12,000+ Stars
DiffSynth-Studio is an open-source diffusion model tool by ModelScope with 12,000+ GitHub stars. This guide covers its features, community momentum, and accessibility for AI image generation.
Read more →
Product Reviews·4 min
Chatbox Open-Source AI Client: The Power Behind 40K Stars and a Complete Usage Guide
Deep dive into Chatbox, an open-source AI desktop client with nearly 40K GitHub Stars. Supports multi-model switching via API (OpenAI, Claude, etc.) with local data storage for privacy-conscious users.
Read more →
Product Reviews·2 min
Unsloth: The Free Local LLM Training Tool with 60K+ Stars on GitHub — A Complete Guide
Unsloth is a 63K-star open-source tool for local LLM training with Web UI. Supports Gemma 4, Qwen 3, DeepSeek fine-tuning with 2-5x speed boost on consumer GPUs.
Read more →
Product Reviews·3 min
8K Stars on GitHub: Deep Dive into the Most Comprehensive LLM Learning Resource Repository
Deep dive into the GitHub project awesome-LLM-resources (8200+ stars): a comprehensive guide covering multimodal AI, AI Agents, MCP protocol, model training, inference optimization, and small language models.
Read more →
Product Reviews·5 min
AnythingLLM: Open-Source AI Knowledge Base with 60K Stars, Local Deployment with Privacy First
AnythingLLM is an open-source AI knowledge base tool with nearly 60K GitHub Stars. It supports local deployment, RAG, multi-model switching, and document parsing with zero-config setup, offering privacy-first AI productivity for enterprises and individuals.
Read more →
Product Reviews·3 min
Cube Studio Deep Dive: Tencent's Open-Source Cloud-Native AI Platform — A Complete MLOps Workflow Guide
Deep dive into Cube Studio, Tencent Music's open-source cloud-native AI platform covering distributed training, LLM SFT/RLHF fine-tuning, vLLM inference, VGPU virtualization, and domestic chip adaptation for complete MLOps workflows.
Read more →
Product Reviews·2 min
The Complete DeepSeek API Integration Ecosystem: Deep Dive into a 37,000+ Star Open Source Project
Deep analysis of DeepSeek's awesome-deepseek-integration with 37,000+ Stars: integration ecosystem, core value, developer onboarding guide, and future trends for connecting DeepSeek API to mainstream workflows.
Read more →
Product Reviews·4 min
Cube Studio Deep Dive: A Practical Guide to Tencent's Open-Source One-Stop MLOps Platform
Deep dive into Tencent's open-source Cube Studio: architecture, large model training/fine-tuning, vLLM inference, distributed training ecosystem, Ascend adaptation, and VGPU compute management for enterprise MLOps.
Read more →
Deep Dives·3 min
Langflow Deep Dive: The AI Workflow Visual Builder with 140K+ GitHub Stars
Deep dive into Langflow, the open-source AI workflow builder with 147K GitHub Stars. Explore its drag-and-drop visual editor, LangChain integration, RAG building capabilities, and low-code AI development features.
Read more →
Product Reviews·4 min
Unsloth: The Efficient Tool for Local Open-Source LLM Training — The Secret Behind 60K+ GitHub Stars
In-depth analysis of Unsloth, a 60K+ star open-source LLM training tool supporting Gemma 4, Qwen3, DeepSeek local fine-tuning with LoRA/QLoRA to dramatically reduce VRAM requirements.
Read more →
Tutorials·5 min
Ollama Tutorial: One-Click Local Deployment of DeepSeek and Other LLMs
Ollama is an open-source tool with 170K+ GitHub Stars for running DeepSeek, Qwen, Gemma and other LLMs locally. Learn installation, supported models, use cases and core advantages.
Read more →
Product Reviews·2 min
IBM Granite 4.1 Open-Source Models: Hands-On SVG Generation Test Across 21 Quantized Versions
IBM releases Granite 4.1 open-source LLMs (Apache 2.0). Simon Willison tests 21 GGUF quantized versions on SVG generation, revealing model size matters far more than quantization precision.
Read more →
Tutorials·3 min
8000+ GitHub Stars: Deep Dive into the Most Comprehensive LLM Learning Resource Repository
Deep dive into the 8000+ star GitHub project awesome-LLM-resources, covering multimodal AI, AI Agents, MCP protocol, model training & inference, and more.
Read more →