#LLM serving
1087 related articles
Expert Opinions·2 min
The Vibe Coding Era: Why We Need RSS to Distribute Personal AI Apps
As vibe coding makes app development as frequent as blogging, we need lightweight mechanisms like RSS to discover and share personal AI tools. Exploring the future infrastructure of AI app distribution.
Read more →
Tutorials·4 min
Hugging Face Transformers: Deep Dive & Practical Guide to the 160K-Star AI Model Framework
Deep dive into Hugging Face Transformers: core features, multi-framework support, 500K+ pretrained models, full-modality task coverage, and hands-on code examples to build AI apps efficiently.
Read more →
Tech Frontiers·2 min
Codex CLI /goal Command Explained: AI Coding Agent Loops Automatically Until the Goal Is Done
Deep dive into Codex CLI 0.128.0's new /goal command: how prompt templates drive autonomous agent loops, token budget controls, and AI coding agents that work until the goal is done.
Read more →
Tutorials·3 min
Microsoft's Open-Source Generative AI Course: 21 Lessons to Build AI Apps from Scratch (110K Stars)
Microsoft's official open-source Generative AI for Beginners course features 21 lessons covering LLM fundamentals, Prompt Engineering, and hands-on AI app development. 110K+ GitHub Stars, Jupyter Notebook-based learning for developers.
Read more →
Expert Opinions·2 min
In the Vibe Coding Era, Why RSS Is the Best Solution for Sharing Personal Apps
Vibe Coding makes building apps as easy as blogging, but how are these personal micro-apps discovered? Matt Webb proposes RSS for distributing vibe-coded apps, and Simon Willison has already implemented it.
Read more →
Product Reviews·4 min
Deep Dive into RuoYi-Vue-Pro: A 37K Star Enterprise-Grade Java Full-Stack Development Framework
Deep dive into RuoYi-Vue-Pro: a Spring Boot + Vue enterprise backend system with 37K Stars, featuring SaaS multi-tenancy, workflow, e-commerce, CRM, ERP, AI, and IoT modules.
Read more →
Product Reviews·4 min
Cube Studio Deep Dive: Tencent's Open-Source One-Stop Cloud-Native AI Platform
Deep dive into Tencent's open-source AI platform Cube Studio, covering distributed training, LLM fine-tuning, inference deployment, VGPU virtualization, and domestic hardware support for enterprise MLOps.
Read more →
Product Reviews·3 min
The Complete Guide to AnythingLLM: A Privacy-First AI Tool with 60K Stars on GitHub
In-depth guide to AnythingLLM, a privacy-first open-source AI tool covering local deployment, RAG document chat, multi-model support, and more for building a secure private AI workbench.
Read more →
Product Reviews·4 min
LibreChat: A Complete Guide to the Open-Source Multi-Model AI Chat Platform
In-depth guide to LibreChat, an open-source AI chat platform covering multi-model aggregation, MCP protocol, Agents, code interpreter, deployment tutorials, and comparisons with alternatives.
Read more →
Product Reviews·5 min
awesome-LLM-resources: A Deep Dive into GitHub's 8K-Star Comprehensive LLM Resource Repository
Deep analysis of the GitHub project awesome-LLM-resources covering LLM training, inference, Agent, MCP, multimodal, small language models, o1 reasoning and more — an 8200+ Star one-stop LLM resource guide.
Read more →
Product Reviews·3 min
RuoYi-Vue-Pro Deep Dive: A 36k Star Enterprise-Grade Java Development Platform
Deep dive into RuoYi-Vue-Pro: an enterprise-grade full-stack platform built on Spring Boot + Vue with 36k+ GitHub Stars, featuring RBAC, workflow, e-commerce, CRM, ERP, AI, and IoT modules.
Read more →
Product Reviews·3 min
Simon Willison Builds an iNaturalist Observation Tracker with His Phone + Claude Code
Simon Willison built an iNaturalist observation visualization tool while camping using his phone and Claude Code, featuring a Python CLI, Git Scraping, and pure frontend three-layer architecture.
Read more →
Tech Frontiers·3 min
LLM 0.32 Refactoring Explained: Message Sequence API and Typed Streaming Responses
Deep dive into Simon Willison's LLM Python library 0.32 refactoring: new message sequence API, typed streaming responses, and universal serialization for multimodal AI and tool calling.
Read more →
Expert Opinions·3 min
Why Zig Completely Bans AI Contributions: An Open Source Philosophy That Invests in People, Not Code
Zig implements the strictest anti-LLM policy in open source, banning all AI-generated contributions. A deep dive into its "Contributor Poker" philosophy and implications for open source governance.
Read more →
Product Reviews·4 min
Hugging Face Transformers: The Technical Architecture & Practical Guide Behind 160K Stars
Deep dive into Hugging Face Transformers: core architecture, Pipeline API, model fine-tuning, and multimodal support. A practical guide to the 160K-star AI framework.
Read more →
Product Reviews·4 min
RuoYi-Vue-Pro Deep Dive: A 37K Star Enterprise-Grade Java Development Platform
Deep dive into RuoYi-Vue-Pro: a 37K Star enterprise Java platform built on Spring Boot + MyBatis Plus, featuring RBAC, SaaS multi-tenancy, workflows, and AI/IoT modules.
Read more →
Product Reviews·5 min
LobeHub Deep Dive: The 76K Star Open-Source Multi-Agent Collaboration Platform
Deep dive into LobeHub, the open-source AI Agent platform with 76K GitHub stars. Explore multi-agent collaboration, team design, and TypeScript architecture that's redefining human-AI interaction.
Read more →
Product Reviews·4 min
AnythingLLM: A Privacy-First RAG Platform with 60K Stars for Local AI Knowledge Bases
Deep analysis of AnythingLLM: a 60K-Star open-source AI platform supporting local deployment, zero-config setup, built-in RAG document Q&A, and vector database for privacy-first AI productivity.
Read more →
Product Reviews·5 min
LobeHub Open Source Platform Analysis: How 76K Stars Multi-Agent Collaboration Is Reshaping Work
Deep analysis of LobeHub's open-source multi-agent collaboration platform with 76K+ GitHub Stars. Explore its core features, technical architecture, community ecosystem, and how multi-Agent collaboration is reshaping the future of work.
Read more →
Product Reviews·4 min
Unsloth: The Open-Source Tool That Makes Local LLM Fine-Tuning 5x Faster
Unsloth is an open-source LLM fine-tuning tool with 63K+ GitHub stars. Supporting Gemma 4, Qwen 3, and DeepSeek, it boosts training speed 2-5x and cuts VRAM by 80% via LoRA/QLoRA, with a Web UI for easy local fine-tuning.
Read more →