#AI inference optimization
1807 related articles
Product Reviews·1 min
GitHub 8K+ Stars Project: Deep Dive into the Most Comprehensive LLM Learning Resource Repository
Deep dive into awesome-LLM-resources, a GitHub 8K+ star project offering the most comprehensive LLM learning resources covering Agents, MCP, multimodal AI, and more.
Read more →
Product Reviews·1 min
Hugging Face Transformers: A Complete Guide to the AI Model Framework with 160K Stars
Explore Hugging Face Transformers, the 160K-star open-source framework for AI models covering text, vision, audio, and multimodal with unified APIs.
Read more →
Product Reviews·1 min
Unsloth: A Powerful Tool for Training Open-Source LLMs Locally
Unsloth is an open-source tool with 63K+ GitHub stars that provides a Web UI for locally training and running LLMs like Gemma 4, Qwen3.6, and DeepSeek.
Read more →
Product Reviews·1 min
Unsloth: A Powerful Tool for Locally Training and Running Open-Source LLMs
Unsloth is an open-source tool with 63K+ GitHub stars for locally training and running LLMs like Gemma 4, Qwen3.6, and DeepSeek with optimized VRAM usage.
Read more →
Tech Frontiers·3 min
Programmer Yupi Open-Sources yupi-skill: Distilling Personal Experience into an AI Agent Skill Package
Programmer Yupi open-sources yupi-skill on GitHub, distilling coding experience into an Agent Skill package for Claude Code, Cursor, and other AI tools.
Read more →
Product Reviews·4 min
RuoYi-AI Open Source Framework: A One-Stop Solution for Java Enterprise AI Application Development
A deep dive into RuoYi-AI, a Java-based enterprise AI development platform supporting multi-vendor LLM integration, RAG knowledge bases, and agent orchestration. 5,200+ Stars on GitHub.
Read more →
Tutorials·3 min
MiniMind-V: A Complete Tutorial to Train a 65M Parameter Vision Multimodal LLM from Scratch in 2 Hours
MiniMind-V is a lightweight open-source VLM project that trains a 65M parameter vision multimodal model from scratch in just 2 hours. Learn its architecture, training pipeline, and educational value.
Read more →
Product Reviews·2 min
NadirClaw: Open-Source LLM Router That Automatically Saves 40-70% on AI API Costs
NadirClaw is an open-source, self-hosted LLM router that automatically routes simple tasks to cheap models and complex tasks to premium ones, saving 40-70% on AI API costs with OpenAI-compatible proxy support.
Read more →
Product Reviews·2 min
Claude Code Prompt Optimizer: Using AI to Automatically Rewrite Prompts for Better Code Generation
Explore claude-code-prompt-optimizer: an open-source tool using Hook interception and Claude Opus to auto-rewrite simple prompts into structured instructions, boosting Claude Code output quality.
Read more →
Product Reviews·4 min
Cube Studio: Tencent's Open-Source All-in-One AI Platform Covering the Full Pipeline from Large Model Training to Inference
Deep dive into Tencent Music's open-source Cube Studio cloud-native AI platform, covering distributed training, LLM fine-tuning, vLLM inference, VGPU virtualization, and Huawei Ascend adaptation.
Read more →
Product Reviews·3 min
awesome-LLM-resources: Deep Dive into a GitHub 8000+ Star LLM Resource Collection
Deep dive into GitHub's 8000+ star project awesome-LLM-resources, covering AI Agents, model training, MCP protocol, multimodal generation and more across 10 core LLM directions.
Read more →
Product Reviews·2 min
9router: An Open-Source Routing Solution for Free Unlimited AI Coding Model Access
9router is an open-source AI model routing tool aggregating 40+ free providers, supporting Claude Code, Cursor, Copilot and more with auto-failover and token compression for free unlimited AI model access.
Read more →
Product Reviews·3 min
GitHub 8,200-Star LLM Resource Hub: Covering the Full Pipeline from Training to Inference to Agents
Deep dive into the 8,200-star awesome-LLM-resources GitHub project covering the full LLM lifecycle: data processing, training, inference, Agents, multimodal, and more.
Read more →
Product Reviews·4 min
Deep Dive into Cube Studio: Tencent's Open-Source All-in-One AI Platform
Deep dive into Tencent's open-source AI platform Cube Studio, covering distributed training, large model fine-tuning and inference, Pipeline orchestration, VGPU virtualization, and Huawei Ascend support for enterprise cloud-native MLOps.
Read more →
Tutorials·4 min
Hugging Face Transformers: Deep Dive & Practical Guide to the 160K-Star AI Model Framework
Deep dive into Hugging Face Transformers: core features, multi-framework support, 500K+ pretrained models, full-modality task coverage, and hands-on code examples to build AI apps efficiently.
Read more →
Product Reviews·2 min
Unsloth: The Open-Source Tool for Fine-Tuning LLMs on a Single GPU with 70% Less VRAM
Unsloth is an open-source LLM fine-tuning tool with 63K+ GitHub stars. Fine-tune Gemma 4, Qwen 3, DeepSeek on a single RTX 3090 with 70% less VRAM, 2-5x faster training, and an intuitive Web UI.
Read more →
Tutorials·3 min
Hugging Face Transformers: The Secret Behind 160K Stars & A Practical Guide
Deep dive into Hugging Face Transformers: the open-source framework with 160K GitHub Stars. Covers full-modality model support, pipeline API, Hub ecosystem, and community mechanisms driving AI democratization.
Read more →
Product Reviews·4 min
Chatbox Open-Source AI Client In-Depth Review: A Cross-Platform Desktop Tool for Multi-Model Aggregation
In-depth review of Chatbox, an open-source AI client supporting unified access to GPT-4, Claude, Gemini and more. Covers core features, tech architecture, and comparisons with alternatives.
Read more →
Tutorials·2 min
Ollama Tutorial: Deep Dive into the 170K-Star Local LLM Framework
Deep dive into Ollama: run DeepSeek, Qwen, Kimi-K2.5 and more locally with one command. Covers installation, model ecosystem, architecture, and use cases for local LLM deployment.
Read more →
Tutorials·4 min
A Beginner's Guide to Hugging Face Transformers: Deep Dive into the 160K-Star Open Source AI Framework
Deep dive into the Hugging Face Transformers framework: core features, multimodal support, Pipeline & Trainer APIs, ecosystem integration, and how this 160K-Star library powers modern AI development.
Read more →