#inference deployment
2072 related articles
Tutorials·3 min
Unsloth Tutorial: Fine-Tune LLMs Locally with Multi-fold Speed Boost and 60% VRAM Savings
Unsloth is an open-source LLM fine-tuning tool with 63K GitHub stars, supporting Gemma 4, Qwen3, and DeepSeek. It achieves multi-fold training speedup and 60% VRAM reduction through kernel optimization, enabling fine-tuning on consumer GPUs.
Read more →
Product Reviews·3 min
Cube Studio: Tencent's Open-Source One-Stop AI Platform — A Deep Dive into Full MLOps Lifecycle
Deep dive into Tencent Music's open-source Cube Studio cloud-native AI platform, covering Notebook development, Pipeline orchestration, distributed training, LLM fine-tuning, inference deployment, and domestic hardware adaptation for full MLOps lifecycle.
Read more →
Product Reviews·2 min
DeepSeek API Integration Ecosystem: Deep Dive into a 37,000-Star GitHub Project
Deep dive into DeepSeek's official awesome-deepseek-integration open-source project with 37,000+ Stars, covering its integration ecosystem, use cases, developer tools, and practical guides.
Read more →
Tutorials·2 min
Unsloth Tutorial: A Guide to Fine-Tuning LLMs Locally with Reduced VRAM and Faster Training
Learn how Unsloth enables efficient local LLM fine-tuning with LoRA optimization, supporting Gemma 4, Qwen3, and DeepSeek while reducing VRAM usage by 50% and boosting training speed 2-5x.
Read more →
Product Reviews·3 min
Deep Dive into CowAgent: The Open-Source AI Assistant with 44,000 Stars
Deep dive into CowAgent (formerly chatgpt-on-wechat), a 44K-star GitHub project offering Agent capabilities, multi-platform integration with WeChat/Feishu, and multi-model support including DeepSeek.
Read more →
Product Reviews·1 min
Unsloth: An Efficient Open-Source Tool for Local LLM Fine-Tuning
Unsloth is a 63,000+ star open-source project on GitHub with a Web UI for locally training and fine-tuning LLMs like Gemma 4, Qwen3, and DeepSeek on consumer GPUs.
Read more →
Product Reviews·3 min
GitHub 8000+ Stars: A Deep Dive into awesome-LLM-resources — The Most Comprehensive Large Language Model Resource Collection
Deep dive into the GitHub 8000+ star project awesome-LLM-resources, covering LLM training, multimodal generation, AI Agents, MCP protocol, AI-assisted coding, and more for developers.
Read more →
Tutorials·3 min
Ollama Tutorial: The Complete Guide to Running Large Models Locally (2025 Updated)
Complete guide to deploying LLMs locally with Ollama. Supports DeepSeek, Qwen, Kimi-K2.5 and more. 170K GitHub Stars, one-click install, full data privacy, zero API costs.
Read more →
Tutorials·2 min
Ollama Tutorial: Complete Guide to Running DeepSeek, Qwen, and Other LLMs Locally with One Click
Complete guide to Ollama: install and run DeepSeek, Qwen, Kimi-K2.5, GLM-5 and more LLMs locally. 170K+ GitHub Stars, the most popular local LLM framework for offline AI inference and privacy.
Read more →
Deep Dives·2 min
Open Multi-Agent: A TypeScript Multi-Agent Orchestration Framework with Automatic Task DAG Generation
Deep dive into Open Multi-Agent, a TypeScript-native multi-agent orchestration framework with automatic task DAG generation, MCP integration, live tracing, and only three runtime dependencies. 6000+ GitHub Stars.
Read more →
Product Reviews·1 min
AIChat: A Deep Dive into the All-in-One LLM Command-Line Tool Built with Rust
AIChat is a Rust-based all-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, and AI Agents with support for OpenAI, Claude, Gemini, and more.
Read more →
Deep Dives·1 min
Hugging Face Transformers: A Complete Guide to the AI Model Framework with 160K Stars
Explore Hugging Face Transformers, the 160K-star open-source AI framework powering text, vision, audio, and multimodal models with elegant APIs and massive community support.
Read more →
Product Reviews·1 min
GitHub 8K+ Stars Project: Deep Dive into the Most Comprehensive LLM Learning Resource Repository
Deep dive into awesome-LLM-resources, a GitHub 8K+ star project offering the most comprehensive LLM learning resources covering Agents, MCP, multimodal AI, and more.
Read more →
Product Reviews·1 min
Hugging Face Transformers: A Complete Guide to the AI Model Framework with 160K Stars
Explore Hugging Face Transformers, the 160K-star open-source framework for AI models covering text, vision, audio, and multimodal with unified APIs.
Read more →
Product Reviews·1 min
Unsloth: A Powerful Tool for Training Open-Source LLMs Locally
Unsloth is an open-source tool with 63K+ GitHub stars that provides a Web UI for locally training and running LLMs like Gemma 4, Qwen3.6, and DeepSeek.
Read more →
Product Reviews·1 min
Cube Studio: Deep Dive into Tencent's Open-Source Cloud-Native All-in-One AI Platform
Deep dive into Cube Studio, Tencent's open-source cloud-native AI platform covering the full MLOps lifecycle from data labeling to large model training and inference deployment.
Read more →
Product Reviews·1 min
nanobot: Ultra-Lightweight Personal AI Agent Goes Viral on GitHub
nanobot, an ultra-lightweight personal AI Agent from HKUDS, has gone viral on GitHub with 41K+ Stars. Learn why this minimalist framework is reshaping the AI Agent landscape.
Read more →
Product Reviews·1 min
Unsloth: A Powerful Tool for Locally Training and Running Open-Source LLMs
Unsloth is an open-source tool with 63K+ GitHub stars for locally training and running LLMs like Gemma 4, Qwen3.6, and DeepSeek with optimized VRAM usage.
Read more →
Tech Frontiers·3 min
Programmer Yupi Open-Sources yupi-skill: Distilling Personal Experience into an AI Agent Skill Package
Programmer Yupi open-sources yupi-skill on GitHub, distilling coding experience into an Agent Skill package for Claude Code, Cursor, and other AI tools.
Read more →
Product Reviews·4 min
RuoYi-AI Open Source Framework: A One-Stop Solution for Java Enterprise AI Application Development
A deep dive into RuoYi-AI, a Java-based enterprise AI development platform supporting multi-vendor LLM integration, RAG knowledge bases, and agent orchestration. 5,200+ Stars on GitHub.
Read more →