#self-hosted LLM
140 related articles
·3 min
Laguna S 2.1: The Open-Source Coding Model That's 14x Smaller Yet Stronger
Poolside releases Laguna S 2.1, an open-source agentic coding model: 118B total params with only 8B active, scoring 40.4% on DeepSWE — ~4.5x DeepSeek V4 Pro Max. Supports 1M-token context, deployable on a single workstation.
Read more →
·3 min
DeepSeek Open-Sources DeepSpec: A Full-Stack Speculative Decoding Library with 60–85% Inference Speedup
DeepSeek open-sources DeepSpec, a full-stack speculative decoding library delivering 60–85% inference speedup and up to 661% throughput gains in production. MIT license, 9 checkpoints, 9 benchmarks.
Read more →
GitHub Daily · July 24: Agentic Tools …
·3 min
GitHub Daily · July 24: Agentic Tools Blossom Everywhere, from CMS to Databases Embracing AI
GitHub Trending July 24: Agentic capabilities go from concept to standard feature. Instatic and Chat2DB deeply integrate AI into CMS and database clients, while dive-into-llms remains the go-to Chinese LLM tutorial.
Read more →
GitHub Daily · July 24: Agentic Tools …
·3 min
GitHub Daily · July 24: Agentic Tools Blossom Everywhere, From CMS to Databases Embracing AI
GitHub Trending July 24: Agentic capabilities go from concept to standard, with Instatic and Chat2DB embedding AI deeply into CMS and database clients.
Read more →
·6 min
Hands-On with Panel AI On-Premises Deployment: One-Click Enterprise Adoption and Unified Compute Cluster Scheduling
In-depth review of Panel AI v1.1.1: second-level installation, no-public-IP networking, batch compute cluster management. Learn how enterprise AI on-premises deployment barriers are dramatically lowered.
Read more →
GitHub Daily · July 23: The Duet of Ru…
·3 min
GitHub Daily · July 23: The Duet of Rust's Dominance and the AI Agent Collaboration Paradigm
GitHub Trending July 23: block/buzz tops the chart with 3,252 stars, Rust dominates system tools, and AI Agents shift from tools to parallel collaborators.
Read more →
·3 min
Qwen3.8 Deep Dive: How Does a 2.4 Trillion Parameter MoE Model Claim Second Place?
Alibaba's Qwen3.8 challenges larger models with a 2.4T-parameter MoE architecture, claiming second only to Gemini. A deep dive into MoE mechanics, continuous updates, two-speed release strategy, and real local deployment requirements.
Read more →
·2 min
Voice AI Agent Architecture: Pipecat Flows vs Vapi Squad — A Deep Comparison
A deep comparison of Pipecat Flows and Vapi Squad for voice AI agent architecture — covering latency, accuracy, multi-agent handoffs, and when to use each.
Read more →
·3 min
Agent Fine-Tuning in Practice: A Complete Guide to Training Your Own AI Agent
A deep dive into Agent Tuning: from LLM hallucination and staleness issues to RAG vs. Agent architecture, the 4-step fine-tuning process, and cost analysis for building your own AI agent.
Read more →
WrenAI: An Open-Source GenBI Tool for …
·4 min
WrenAI: An Open-Source GenBI Tool for Querying Databases with Natural Language
WrenAI is an open-source GenBI tool by the Canner team that converts natural language into trusted SQL, charts, and dashboards via a semantic layer. Supports 20+ data sources including BigQuery and Snowflake. 16,000+ GitHub stars.
Read more →
croc: Open-Source CLI File Transfer To…
·2 min
croc: Open-Source CLI File Transfer Tool — Secure, Cross-Platform, Zero Config
croc is an open-source Go-based CLI file transfer tool with PAKE end-to-end encryption. Cross-platform, resumable, zero config — send files securely with one command.
Read more →
GitHub Daily · July 22: Financial Foun…
·3 min
GitHub Daily · July 22: Financial Foundation Model Kronos Leads, Architecture Visualization and the Claude Skills Ecosystem Soar
GitHub Trending July 22: Kronos brings the foundation model paradigm to finance, awesome-claude-skills tops with 70K stars, plus LikeC4 architecture-as-code and Rust-based Pumpkin.
Read more →
·3 min
Dify 1.8 Complete Beginner's Guide: Build 20+ AI Apps Fast
A complete Dify 1.8 guide covering 3 deployment methods (Docker/cloud/source), MySQL integration, 5 app types (Chatbot/Agent/Workflow), model selection, and publishing strategies.
Read more →
·3 min
Dify Getting Started: A Complete Zero-to-Production Guide for Building AI Applications
A complete guide to Dify — covering deployment, five core app types (chatbot, Agent, workflow, and more), LLM integration, and publishing for zero-experience developers.
Read more →
·3 min
Coze Deep Dive: A Complete Guide to the Agent Building Platform vs. Dify
A deep dive into ByteDance's Coze platform: tool categories, positioning vs. Dify, skill store, multi-agent collaboration, and workflow building — your AI Agent selection guide.
Read more →
·2 min
Dependency Drift in Production AI Agents: Detection, Response, and Building Resilient Systems
AI Agents in production face systemic dependency drift risks — model updates silently change outputs and silent failures are hard to detect. Learn detection strategies, hidden costs, and engineering practices.
Read more →
AstrBot: A Deep Dive into the Multi-Pl…
·2 min
AstrBot: A Deep Dive into the Multi-Platform AI Agent Development Framework
AstrBot is an open-source AI Agent framework supporting WeChat, QQ, Telegram and more, with multi-LLM compatibility and plugin extensibility. Full technical breakdown inside.
Read more →
Cognee: The Open-Source Knowledge Grap…
·2 min
Cognee: The Open-Source Knowledge Graph Engine for Persistent AI Agent Memory
Cognee is an open-source AI memory platform using knowledge graphs to give AI agents persistent cross-session memory. Self-hosted, graph + vector hybrid retrieval. 28K+ GitHub stars.
Read more →
Self-Hosted Voice AI Assistant: Bringi…
·2 min
Self-Hosted Voice AI Assistant: Bringing Conversational Intelligence to Asterisk/FreePBX
Explore a self-hosted voice AI assistant built for Asterisk and FreePBX: keep data on-premises, integrate with existing PBX, replace legacy IVR, and deploy local voice intelligence affordably.
Read more →
AIRI: The Open-Source Self-Hosted AI C…
·2 min
AIRI: The Open-Source Self-Hosted AI Companion to Build Your Own Cyber Neuro-sama
AIRI (moeru-ai/airi) is an open-source, self-hosted AI companion with real-time voice chat, Minecraft/Factorio gameplay, and Web/macOS/Windows support. 42K+ GitHub stars.
Read more →