#vLLM
332 related articles
Product Reviews·4 min
Cube Studio Deep Dive: Tencent's Open-Source One-Stop MLOps Platform
Deep dive into Cube Studio, Tencent Music's open-source one-stop AI platform, covering architecture design, distributed training, large model fine-tuning and inference, and domestic chip adaptation.
Read more →
Product Reviews·4 min
Hugging Face Transformers: Deep Dive into the 160K-Star Open Source AI Model Framework
Deep dive into Hugging Face Transformers: architecture, multimodal support, ecosystem, and trends. Learn how this 160K-Star project became essential for AI developers.
Read more →
Product Reviews·4 min
GPT-OSS 120B/20B Open-Source Model In-Depth Review: Comprehensive Testing on Hallucination, Reasoning, and Code
Comprehensive review of OpenAI's open-source GPT-OSS 120B and 20B models covering hallucination testing, logical reasoning, code generation, SQL queries, and document analysis with deployment guides.
Read more →
Tutorials·3 min
OpenAI Open-Sources GPT-OSS: Run O4-Level Models on 16GB VRAM — Complete Deployment Guide
OpenAI open-sources GPT-OSS (20B/120B) with MOE architecture and native FP4 precision. Run O3-level reasoning on a single RTX 4090. Full deployment guide for Ollama, vLLM, and more.
Read more →
Industry Insights·4 min
Why AI-Generated Test Cases Fall Short — And Why Agent Platforms Are the Real Solution
Deep analysis of 5 common pitfalls in AI-generated test cases and how Agent+Skill platforms solve them with automated requirement splitting, precise generation, and end-to-end test execution.
Read more →
Tutorials·3 min
GPT-OSS-20B Private Deployment Guide: Hardware Selection + Deployment Process + Performance Testing
Complete guide to privately deploying OpenAI's open-source GPT-OSS-20B: GPU selection (RTX 5090/V100/4070Ti), Linux deployment steps, API configuration, and real-world benchmarks with 120B hardware comparison.
Read more →
Tutorials·4 min
2025 LLM Career Transition Roadmap: A Three-Phase Plan from Foundations → Frameworks → Real-World Projects
A systematic 2025 LLM career transition roadmap covering Python, Transformers, LangChain, LlamaIndex, RAG, Agent development, and fine-tuning across three phases achievable in 2-3 months.
Read more →
Tutorials·2 min
ChatBox Mobile Installation & Configuration Guide: Complete Setup for Claude Model Access via API
Step-by-step guide to install ChatBox on mobile and configure API access to Claude models. Covers API key setup, host address, model parameters, and connection testing in under 5 minutes.
Read more →
Tutorials·4 min
Claude Code Hands-On Tutorial: Installation, DeepSeek Integration & Programming Tips - Complete Guide
Complete guide to Claude Code installation, DeepSeek V4 Pro integration, IDE setup, with a real full-stack project demo, Skill system, MCP configuration, and 10 AI programming tips.
Read more →
Tutorials·3 min
WSL2 Installation Guide: Complete Tutorial from Setup to Non-System Drive Migration
Complete WSL2 installation tutorial covering enabling Windows features, installing Ubuntu 22.04, and migrating to a non-system drive. Includes PowerShell commands and user configuration for AI developers.
Read more →
Tech Frontiers·3 min
Gemma 4 + DGX Spark: How Open-Source LLMs and Desktop-Level Compute Are Changing AI Development
NVIDIA and Google DeepMind jointly showcase Gemma 4's vision translation, long-context Q&A, and real-time code generation on DGX Spark, signaling the convergence of open-source AI and edge compute.
Read more →
Tutorials·4 min
AI-Powered Research in Practice: From LLM Selection to Building Automated Workflows with N8N
A deep dive into AI-driven research methodology: LLM selection, Python automation, Zotero reference management, Overleaf writing, local LLM deployment, and N8N workflow automation.
Read more →
Deep Dives·3 min
Microsoft Tutel: A Deep Dive into the MoE Model Acceleration Library with FP4/FP8 Low-Precision Support
A deep dive into Microsoft's open-source Tutel MoE optimization library, supporting FP8, NVFP4, and MXFP4 multi-precision computation for DeepSeek, Kimi-K2, Qwen3, and other leading MoE models.
Read more →
Product Reviews·3 min
awesome-LLM-resources: A Comprehensive Analysis of the 8,200-Star LLM Learning Resource Repository on GitHub
In-depth analysis of the 8,200-star GitHub project awesome-LLM-resources, covering multimodal generation, Agents, model training, MCP protocol, and more — a one-stop LLM learning guide.
Read more →
Deep Dives·4 min
Hugging Face Transformers: Deep Dive into the 160K-Star Open Source AI Framework
Deep dive into Hugging Face Transformers: the 160K-Star open-source framework covering Pipeline API, Auto Classes, multi-modal models, and the full HF ecosystem for AI inference and training.
Read more →
Product Reviews·3 min
Cube Studio: A Comprehensive Analysis of Tencent's Open-Source Cloud-Native AI Platform
Deep dive into Tencent Music's open-source Cube Studio cloud-native AI platform, covering distributed training, LLM fine-tuning & inference, Pipeline orchestration, and domestic hardware adaptation.
Read more →
Tutorials·3 min
GitHub 8K Stars: Deep Dive into the Most Comprehensive LLM Resource Repository
Deep analysis of the GitHub project awesome-LLM-resources with 8,200+ Stars, covering multimodal AI, Agents, MCP protocol, model training, inference optimization, and coding assistants.
Read more →
Product Reviews·2 min
Unsloth: 80% VRAM Reduction — The Best Open-Source Tool for Local LLM Fine-Tuning
Unsloth is an open-source LLM training tool with 63K+ GitHub stars, supporting Gemma 4, Qwen 3, DeepSeek. Reduces VRAM by 50–80%, enabling RTX 4090 to fine-tune 7B models with a no-code Web UI.
Read more →
Tech Frontiers·3 min
Guardrails AI Hit by Supply Chain Attack: A Complete Breakdown of Operation Mini Shai-Hulud
Guardrails AI's PyPI package guardrails-ai 0.10.1 was hit by the Mini Shai-Hulud supply chain attack, along with TanStack and Mistral. Full analysis and developer remediation guide inside.
Read more →
Tech Frontiers·2 min
Kimi K2 Official Verification Tool K2-Vendor-Verifier: One-Click API Vendor Model Accuracy Detection
Moonshot AI open-sources K2-Vendor-Verifier to verify third-party Kimi K2 API vendor inference accuracy. Learn how this tool helps developers detect over-quantization, model substitution, and other API market risks.
Read more →