#vLLM
327 related articles
Product Reviews·2 min
Lingque AI Agent Framework: A Self-Controlled Solution for Private Deployment
Lingque is a Python-based open-source AI Agent framework supporting fully private deployment with data sovereignty. This article analyzes its technical features, use cases, and advantages over LangChain.
Read more →
Product Reviews·3 min
Micro-Agent: Fudan University's Open-Source Lightweight AI Agent Framework Built for Vertical Domains
Micro-Agent is a lightweight AI Agent framework open-sourced by Fudan University, focused on vertical domain applications. It offers streamlined architecture, low learning costs, and high customization flexibility compared to heavyweight frameworks like LangChain.
Read more →
Product Reviews·2 min
Fay Open-Source Agent Framework: The Connection Layer Between Digital Humans and Business Systems
Fay is an open-source Agent framework with 12,700+ GitHub Stars, connecting digital humans, LLMs like DeepSeek, and enterprise systems for customer service, virtual streaming, and more.
Read more →
Tutorials·3 min
Hermes Agent Orange Book: A Practical Guide to the 3600+ Star Open-Source AI Agent Framework
A deep dive into Nous Research's Hermes Agent open-source AI framework and the community Orange Book guide covering tool calling, reasoning, multi-Agent collaboration, and more.
Read more →
Product Reviews·2 min
Deep Research Web UI: An Open-Source AI Deep Research Assistant with DeepSeek R1 Support
Deep Research Web UI is an open-source AI research assistant supporting DeepSeek R1, enabling automated deep research through iterative search, web scraping, and LLM reasoning. 2100+ Stars on GitHub.
Read more →
Deep Dives·2 min
SAP AI Core LLM Proxy: An Enterprise-Grade Proxy for Unified Access to GPT-5 and Other Leading LLMs
Deep dive into SAP AI Core LLM Proxy, an open-source project providing unified OpenAI-compatible access to GPT-5, Claude 4.6, and Gemini 2.5 Pro for enterprise multi-model management.
Read more →
Deep Dives·2 min
EverClaw Deep Dive: A Decentralized Platform for Earning Permanent AI Inference by Staking MOR Tokens
Deep dive into EverClaw, a decentralized AI inference platform built on Morpheus AI. Stake MOR tokens to access 10+ models including Kimi K2.5 for perpetual inference powering OpenClaw agents.
Read more →
Tech Frontiers·3 min
Kimi-K2.5 Goes Open Source: Moonshot AI's Most Powerful Model Arrives, GitHub Stars Soaring
Moonshot AI open-sources its flagship model Kimi-K2.5, with GitHub stars surpassing 1,900. Learn about its strategic significance, MoE architecture, competition with DeepSeek and Qwen, and how developers can get started.
Read more →
Product Reviews·3 min
The Complete Guide to AnythingLLM: A Privacy-First AI Assistant for Local Deployment
Deep dive into AnythingLLM: a privacy-first, zero-config open-source local AI tool. Supports RAG, multi-model switching, and document chat. Nearly 60K GitHub Stars, ideal for enterprise and personal local deployment.
Read more →
Tutorials·2 min
Ollama Tutorial: One-Click Local Deployment of DeepSeek, Qwen, and Other LLMs
Complete guide to running LLMs locally with Ollama. Supports DeepSeek, Qwen, Kimi-K2.5 & more. Covers installation, model ecosystem, privacy benefits & enterprise deployment. 170K+ GitHub Stars.
Read more →
Product Reviews·3 min
Cube Studio: Tencent's Open-Source One-Stop AI Platform — A Deep Dive into Full MLOps Lifecycle
Deep dive into Tencent Music's open-source Cube Studio cloud-native AI platform, covering Notebook development, Pipeline orchestration, distributed training, LLM fine-tuning, inference deployment, and domestic hardware adaptation for full MLOps lifecycle.
Read more →
Product Reviews·1 min
Cube Studio: Deep Dive into Tencent's Open-Source Cloud-Native All-in-One AI Platform
Deep dive into Cube Studio, Tencent's open-source cloud-native AI platform covering the full MLOps lifecycle from data labeling to large model training and inference deployment.
Read more →
Product Reviews·4 min
Cube Studio: Tencent's Open-Source All-in-One AI Platform Covering the Full Pipeline from Large Model Training to Inference
Deep dive into Tencent Music's open-source Cube Studio cloud-native AI platform, covering distributed training, LLM fine-tuning, vLLM inference, VGPU virtualization, and Huawei Ascend adaptation.
Read more →
Product Reviews·3 min
awesome-LLM-resources: Deep Dive into a GitHub 8000+ Star LLM Resource Collection
Deep dive into GitHub's 8000+ star project awesome-LLM-resources, covering AI Agents, model training, MCP protocol, multimodal generation and more across 10 core LLM directions.
Read more →
Product Reviews·2 min
Chatbox: A Detailed Look at the Open-Source Multi-Model AI Desktop Client
Chatbox is an open-source AI client with nearly 40K GitHub Stars, supporting ChatGPT, Claude, Gemini and local models with cross-platform desktop apps, local data storage, and Prompt management.
Read more →
Product Reviews·2 min
9router: An Open-Source Routing Solution for Free Unlimited AI Coding Model Access
9router is an open-source AI model routing tool aggregating 40+ free providers, supporting Claude Code, Cursor, Copilot and more with auto-failover and token compression for free unlimited AI model access.
Read more →
Product Reviews·3 min
GitHub 8,200-Star LLM Resource Hub: Covering the Full Pipeline from Training to Inference to Agents
Deep dive into the 8,200-star awesome-LLM-resources GitHub project covering the full LLM lifecycle: data processing, training, inference, Agents, multimodal, and more.
Read more →
Product Reviews·4 min
Deep Dive into Cube Studio: Tencent's Open-Source All-in-One AI Platform
Deep dive into Tencent's open-source AI platform Cube Studio, covering distributed training, large model fine-tuning and inference, Pipeline orchestration, VGPU virtualization, and Huawei Ascend support for enterprise cloud-native MLOps.
Read more →
Tutorials·4 min
Hugging Face Transformers: Deep Dive & Practical Guide to the 160K-Star AI Model Framework
Deep dive into Hugging Face Transformers: core features, multi-framework support, 500K+ pretrained models, full-modality task coverage, and hands-on code examples to build AI apps efficiently.
Read more →
Tutorials·2 min
Ollama Tutorial: Deep Dive into the 170K-Star Local LLM Framework
Deep dive into Ollama: run DeepSeek, Qwen, Kimi-K2.5 and more locally with one command. Covers installation, model ecosystem, architecture, and use cases for local LLM deployment.
Read more →