#LLM inference performance
1546 related articles
Product Reviews·4 min
Unsloth: The Open-Source Tool That Makes Local LLM Fine-Tuning 5x Faster
Unsloth is an open-source LLM fine-tuning tool with 63K+ GitHub stars. Supporting Gemma 4, Qwen 3, and DeepSeek, it boosts training speed 2-5x and cuts VRAM by 80% via LoRA/QLoRA, with a Web UI for easy local fine-tuning.
Read more →
Tutorials·5 min
The Complete Guide to Ollama: Run DeepSeek and Other LLMs Locally with a Single Command
Ollama is an open-source tool with 170K GitHub Stars that lets you run DeepSeek, Qwen, Kimi-K2.5 and other LLMs locally with one command. Learn about its model ecosystem, advantages, and use cases.
Read more →
Product Reviews·3 min
gpt4free: An In-Depth Look at the Open-Source Project for Free Access to GPT-4, Claude, and More
Deep dive into gpt4free, a 66k-star GitHub project for free access to GPT-4, Claude, and Gemini APIs. Covers features, technical principles, use cases, and compliance risks.
Read more →
Product Reviews·5 min
Unsloth: The Open-Source Tool That Speeds Up Local LLM Fine-Tuning by 5x
Unsloth is an open-source LLM training tool with 63,000+ GitHub Stars. It supports local fine-tuning of Gemma 4, Qwen3, DeepSeek and more, with Web UI, VRAM optimization, and 2-5x training speedup on consumer GPUs.
Read more →
Tutorials·5 min
Google Open-Sources Full-Stack AI Agent Tutorial: Gemini 2.5 + LangGraph Deep Dive
Google open-sources gemini-fullstack-langgraph-quickstart with 18,000+ Stars. Deep dive into the technical architecture, state machine design patterns, and tool-calling mechanisms of building full-stack AI Agents with Gemini 2.5 and LangGraph.
Read more →
Product Reviews·2 min
gpt4free: The Open-Source Tool for Free Access to GPT-4, Claude, and Other Top AI Models
Deep dive into gpt4free, a 66k-star GitHub project offering free access to GPT-5.3, Claude Opus, Gemini 3, DeepSeek and more. Covers architecture, use cases, legal risks, and industry impact.
Read more →
Product Reviews·3 min
NetCoreKevin: An Open-Source .NET Enterprise AI Knowledge Base Agent Architecture in Practice
Deep dive into NetCoreKevin, an open-source .NET project integrating Semantic Kernel and RAG for AI knowledge base agents, with multi-tenant SaaS, MCP protocol, and distributed transaction support.
Read more →
Product Reviews·3 min
Tianshu: Open-Source AI Document Parsing Platform — A One-Stop Solution for PDF to Markdown Conversion
Tianshu (mineru-tianshu) is an enterprise-grade open-source AI document preprocessing platform supporting PDF/Office to Markdown conversion, MCP protocol AI assistant integration, with a Vue3+FastAPI full-stack architecture for RAG systems and enterprise knowledge bases.
Read more →
Tutorials·4 min
Ollama Tutorial: Run DeepSeek and Other LLMs Locally with a Single Command
Complete guide to running LLMs locally with Ollama. Supports DeepSeek, Qwen, Gemma and more. Learn installation, architecture, and use cases—zero API costs with full data privacy.
Read more →
Product Reviews·5 min
Hugging Face Transformers: Deep Dive into the 160K-Star Open Source Framework
Deep dive into Hugging Face Transformers, covering core features, API design, model ecosystem, and practical code examples. Learn how this 160K-Star project lowers AI barriers and drives democratization across LLMs, computer vision, and multimodal AI.
Read more →
Deep Dives·3 min
Ruflo Open-Source Framework: Claude Multi-Agent Orchestration Platform Architecture and Practical Guide
Deep analysis of Ruflo open-source multi-agent orchestration platform, covering swarm intelligence, RAG integration, Claude Code native support, and comparisons with LangGraph and CrewAI.
Read more →
Product Reviews·4 min
Chatbox Open-Source AI Client: The Power Behind 40K Stars and a Complete Usage Guide
Deep dive into Chatbox, an open-source AI desktop client with nearly 40K GitHub Stars. Supports multi-model switching via API (OpenAI, Claude, etc.) with local data storage for privacy-conscious users.
Read more →
Product Reviews·3 min
Chatbox: An Open-Source AI Client with Nearly 40K GitHub Stars, Supporting Unified Multi-Model Management
Deep dive into Chatbox, an open-source AI client with ~40K GitHub Stars. Supports GPT, Claude, Ollama multi-model management with local data storage for privacy across Windows/macOS/Linux.
Read more →
Product Reviews·2 min
Unsloth: The Free Local LLM Training Tool with 60K+ Stars on GitHub — A Complete Guide
Unsloth is a 63K-star open-source tool for local LLM training with Web UI. Supports Gemma 4, Qwen 3, DeepSeek fine-tuning with 2-5x speed boost on consumer GPUs.
Read more →
Product Reviews·3 min
8K Stars on GitHub: Deep Dive into the Most Comprehensive LLM Learning Resource Repository
Deep dive into the GitHub project awesome-LLM-resources (8200+ stars): a comprehensive guide covering multimodal AI, AI Agents, MCP protocol, model training, inference optimization, and small language models.
Read more →
Product Reviews·5 min
DeepSeek API Integration Ecosystem: A Complete Analysis of the 37K-Star Open Source Project
Analysis of the 37K-Star awesome-deepseek-integration project on GitHub, covering DeepSeek API integrations for VS Code, browsers, Obsidian, and more, with quick-start guides for developers.
Read more →
Product Reviews·5 min
AnythingLLM: Open-Source AI Knowledge Base with 60K Stars, Local Deployment with Privacy First
AnythingLLM is an open-source AI knowledge base tool with nearly 60K GitHub Stars. It supports local deployment, RAG, multi-model switching, and document parsing with zero-config setup, offering privacy-first AI productivity for enterprises and individuals.
Read more →
Tutorials·5 min
Codex CLI /goal Command Explained: Autonomous Loop Execution Until Goal Completion
Codex CLI 0.128.0 adds the /goal command for goal-driven autonomous loop execution. This article analyzes its technical implementation, token budget mechanism, and practical use cases.
Read more →
Product Reviews·4 min
Cube Studio Deep Dive: A Practical Guide to Tencent's Open-Source One-Stop MLOps Platform
Deep dive into Tencent's open-source Cube Studio: architecture, large model training/fine-tuning, vLLM inference, distributed training ecosystem, Ascend adaptation, and VGPU compute management for enterprise MLOps.
Read more →
Product Reviews·3 min
UnrealGenAISupport: An In-Depth Analysis of the All-in-One AI Integration Plugin for UE5
In-depth analysis of UnrealGenAISupport, an open-source UE5 plugin integrating GPT-5, Claude, Gemini and dozens of AI models with built-in MCP server for editor control, enabling intelligent NPCs, 3D asset generation, and AI Agent workflows.
Read more →