#LLM inference performance
1609 related articles
Product Reviews·3 min
awesome-LLM-resources: A Deep Dive into GitHub's 8K-Star Comprehensive LLM Learning Resource Repository
Deep dive into awesome-LLM-resources, a GitHub 8K-star project covering multimodal AI, AI Agents, MCP protocol, model training/inference, and AI coding tools — a one-stop LLM learning guide.
Read more →
Tech Frontiers·3 min
LangGraph Multi-Agent Company Research Tool: A Practical Guide to Open-Source AI Due Diligence
Deep dive into the open-source company-research-agent: LangGraph multi-agent architecture + Tavily search + dual-LLM collaboration for automated company due diligence and competitive intelligence.
Read more →
Tutorials·3 min
Building an AI Digital Human Agent from Scratch: Architecture Design & Full Technical Breakdown
Complete guide to building an AI digital human Agent, covering Agent, RAG, WebRTC, and Docker deployment with architecture design and engineering best practices.
Read more →
Expert Opinions·3 min
The Truth About Enterprise Tech Decisions: Why Decision-Makers Keep Chasing AI Buzzwords
HashiCorp founder Mitchell Hashimoto reveals the real driver behind enterprise tech decisions: 90% of TDMs are primarily motivated by not getting fired. A deep dive into the Gartner analyst economy, buzzword industrial chain, and enterprise procurement logic.
Read more →
Deep Dives·3 min
Augment Code Architecture Revealed: Dedicated Subagents Replace KV Cache, Cutting Costs by 90%
Deep dive into how Augment Code uses Mercury 2 dedicated subagents to replace traditional KV cache, achieving 82% faster context compaction, 90% lower summarization costs, and 30% reduced LLM spending.
Read more →
Research·2 min
Prompt Tuning Delivers 3-10% Efficiency Gains: The Hidden Dividend of Scaling Coding Agents
Prompt engineering optimizations for coding Agents reduce tool calls, lower output tokens, and improve completion speed by 3-10%—delivering significant cost savings and latency reduction at scale.
Read more →
Tech Frontiers·2 min
DeepSeek V3.2 Released: Proprietary Sparse Attention (DSA) + 50% API Price Cut Explained
DeepSeek releases V3.2-Exp with proprietary DeepSeek Sparse Attention (DSA) for faster long-context training and inference, plus API prices cut over 50%.
Read more →
Tech Frontiers·2 min
DeepSeek-V3.2-Exp Discovers RoPE Implementation Bug: Interleaved Format Mismatch Causes Inference Performance Degradation
A RoPE interleaved format mismatch bug was found in DeepSeek-V3.2-Exp's inference demo, causing silent performance degradation. Learn the root cause, technical details, and fix.
Read more →
Tech Frontiers·3 min
Simulation Reshaping AI Testing: A New Paradigm for Systematically Validating AI Application Reliability
Explore how simulation solves AI testing challenges, covering scenario simulation, large-scale regression testing, and multi-agent verification to build reliable AI systems.
Read more →
Tech Frontiers·2 min
DeepSeek-V4-Pro API at 75% Off: Full Breakdown of Million-Token Context & Mainstream Tool Integrations
DeepSeek-V4-Pro API is 75% off through May 5, 2026. With 1M-token context and Claude Code/OpenCode integration, here's the full pricing and developer guide.
Read more →
Tutorials·3 min
Using LLMs as Script Interpreters: Shebang Lines Turn Natural Language into Executable Scripts
Simon Willison shows how putting LLM CLI tools in shebang lines turns plain English text files into executable scripts, from basic usage to tool calls and YAML templates.
Read more →
Product Reviews·3 min
MiroFlow Open-Source AI Workflow Framework Review: The Strengths and Concerns Behind Top Rankings Across Multiple Benchmarks
In-depth review of MiroFlow open-source AI workflow framework: technical architecture behind 5+ benchmark Top-1 rankings, multi-model support, Web UI, and comparison with LangChain and Dify.
Read more →
Product Reviews·3 min
PyGPT: Open-Source Desktop AI Assistant with All-in-One Integration of GPT, Claude, Ollama, and More
Deep dive into PyGPT, an open-source desktop AI assistant supporting GPT-4, Claude, Gemini, Ollama local models, with built-in RAG, agents, voice interaction, and image generation.
Read more →
Product Reviews·2 min
Opik: An Open-Source LLM Observability Platform for Debugging, Evaluation, and Monitoring All in One Place
Deep dive into Opik: an open-source platform for LLM app lifecycle management with tracing, automated evaluation, hallucination detection, and production monitoring for RAG and Agent workflows.
Read more →
Product Reviews·2 min
Opik: Open-Source LLM Observability Platform for Debugging, Evaluation, and Monitoring All in One
Deep dive into Opik: an open-source platform for LLM app lifecycle management with tracing, automated evaluation, hallucination detection, and production monitoring. 19K+ GitHub stars.
Read more →
Product Reviews·3 min
LiteLLM: A Deep Dive into the Open-Source Gateway for 100+ LLM APIs
Deep dive into LiteLLM, the open-source AI gateway supporting 100+ LLM APIs with a unified OpenAI format. Covers core features, usage modes, and enterprise use cases.
Read more →
Tutorials·3 min
Hands-On Intelligent Agent Development with LangGraph: From Getting Started to Full Project Architecture
A deep dive into intelligent Agent development with LangGraph, covering core concepts, project architecture, state management, and practical tips for building AI agents in Python.
Read more →
Product Reviews·3 min
Deep Dive into AGGO Framework: A New Go-Based Choice for Enterprise AI Agents
Deep dive into AGGO—an enterprise AI Agent framework built with Go and CloudWeGo Eino, covering conversational AI, RAG, memory systems, and tool calling, with Go's performance advantages.
Read more →
Tutorials·3 min
LangGraph E-commerce AI Agent in Practice: From RAG Q&A to Automated Return Workflows
Deep dive into the E-commerce-Smart-Agent open-source framework built with LangGraph and FastAPI, covering RAG knowledge base Q&A, return workflow automation, and graph-based orchestration.
Read more →
Product Reviews·2 min
Lingque AI Agent Framework: A Self-Controlled Solution for Private Deployment
Lingque is a Python-based open-source AI Agent framework supporting fully private deployment with data sovereignty. This article analyzes its technical features, use cases, and advantages over LangChain.
Read more →