#LLM inference
2305 related articles
Tech Frontiers·2 min
DeepSeek V3.2 Released: Proprietary Sparse Attention (DSA) + 50% API Price Cut Explained
DeepSeek releases V3.2-Exp with proprietary DeepSeek Sparse Attention (DSA) for faster long-context training and inference, plus API prices cut over 50%.
Read more →
Deep Dives·3 min
Why Is AI Agent Testing So Hard? How Simulation Testing Cracks the Infinite Input Space Problem
AI Agents face infinite input spaces and non-deterministic outputs. Learn how simulation testing systematically validates Agent reliability through scenario generation, environment simulation, and behavior evaluation.
Read more →
Tech Frontiers·2 min
DeepSeek-V3.2-Exp Discovers RoPE Implementation Bug: Interleaved Format Mismatch Causes Inference Performance Degradation
A RoPE interleaved format mismatch bug was found in DeepSeek-V3.2-Exp's inference demo, causing silent performance degradation. Learn the root cause, technical details, and fix.
Read more →
Tech Frontiers·3 min
Simulation Reshaping AI Testing: A New Paradigm for Systematically Validating AI Application Reliability
Explore how simulation solves AI testing challenges, covering scenario simulation, large-scale regression testing, and multi-agent verification to build reliable AI systems.
Read more →
Tech Frontiers·2 min
DeepSeek-V4-Pro API at 75% Off: Full Breakdown of Million-Token Context & Mainstream Tool Integrations
DeepSeek-V4-Pro API is 75% off through May 5, 2026. With 1M-token context and Claude Code/OpenCode integration, here's the full pricing and developer guide.
Read more →
Tutorials·3 min
Using LLMs as Script Interpreters: Shebang Lines Turn Natural Language into Executable Scripts
Simon Willison shows how putting LLM CLI tools in shebang lines turns plain English text files into executable scripts, from basic usage to tool calls and YAML templates.
Read more →
Tutorials·3 min
awesome-llm-apps: A 100K-Star GitHub Project with 100+ AI Agent & RAG Applications
awesome-llm-apps is a 100K+ Star GitHub project featuring 100+ ready-to-run AI Agent and RAG apps. Built in Python with clone-and-run simplicity, it's an essential resource for LLM developers.
Read more →
Product Reviews·3 min
MiroFlow Open-Source AI Workflow Framework Review: The Strengths and Concerns Behind Top Rankings Across Multiple Benchmarks
In-depth review of MiroFlow open-source AI workflow framework: technical architecture behind 5+ benchmark Top-1 rankings, multi-model support, Web UI, and comparison with LangChain and Dify.
Read more →
Product Reviews·3 min
PyGPT: Open-Source Desktop AI Assistant with All-in-One Integration of GPT, Claude, Ollama, and More
Deep dive into PyGPT, an open-source desktop AI assistant supporting GPT-4, Claude, Gemini, Ollama local models, with built-in RAG, agents, voice interaction, and image generation.
Read more →
Product Reviews·2 min
Opik: An Open-Source LLM Observability Platform for Debugging, Evaluation, and Monitoring All in One Place
Deep dive into Opik: an open-source platform for LLM app lifecycle management with tracing, automated evaluation, hallucination detection, and production monitoring for RAG and Agent workflows.
Read more →
Product Reviews·2 min
Opik: Open-Source LLM Observability Platform for Debugging, Evaluation, and Monitoring All in One
Deep dive into Opik: an open-source platform for LLM app lifecycle management with tracing, automated evaluation, hallucination detection, and production monitoring. 19K+ GitHub stars.
Read more →
Product Reviews·3 min
LiteLLM: A Deep Dive into the Open-Source Gateway for 100+ LLM APIs
Deep dive into LiteLLM, the open-source AI gateway supporting 100+ LLM APIs with a unified OpenAI format. Covers core features, usage modes, and enterprise use cases.
Read more →
Tutorials·3 min
Hands-On Intelligent Agent Development with LangGraph: From Getting Started to Full Project Architecture
A deep dive into intelligent Agent development with LangGraph, covering core concepts, project architecture, state management, and practical tips for building AI agents in Python.
Read more →
Product Reviews·3 min
Deep Dive into AGGO Framework: A New Go-Based Choice for Enterprise AI Agents
Deep dive into AGGO—an enterprise AI Agent framework built with Go and CloudWeGo Eino, covering conversational AI, RAG, memory systems, and tool calling, with Go's performance advantages.
Read more →
Tutorials·3 min
LangGraph E-commerce AI Agent in Practice: From RAG Q&A to Automated Return Workflows
Deep dive into the E-commerce-Smart-Agent open-source framework built with LangGraph and FastAPI, covering RAG knowledge base Q&A, return workflow automation, and graph-based orchestration.
Read more →
Product Reviews·2 min
Lingque AI Agent Framework: A Self-Controlled Solution for Private Deployment
Lingque is a Python-based open-source AI Agent framework supporting fully private deployment with data sovereignty. This article analyzes its technical features, use cases, and advantages over LangChain.
Read more →
Product Reviews·3 min
Micro-Agent: Fudan University's Open-Source Lightweight AI Agent Framework Built for Vertical Domains
Micro-Agent is a lightweight AI Agent framework open-sourced by Fudan University, focused on vertical domain applications. It offers streamlined architecture, low learning costs, and high customization flexibility compared to heavyweight frameworks like LangChain.
Read more →
Product Reviews·2 min
Fay Open-Source Agent Framework: The Connection Layer Between Digital Humans and Business Systems
Fay is an open-source Agent framework with 12,700+ GitHub Stars, connecting digital humans, LLMs like DeepSeek, and enterprise systems for customer service, virtual streaming, and more.
Read more →
Product Reviews·3 min
Agentica Open-Source Framework Review: A Lightweight Async AI Agent Development Alternative
In-depth review of Agentica, an open-source AI Agent framework featuring async-first architecture, tool calling, RAG, multi-agent collaboration, and MCP protocol support, with comparisons to LangChain and other mainstream frameworks.
Read more →
Tutorials·3 min
Hermes Agent Orange Book: A Practical Guide to the 3600+ Star Open-Source AI Agent Framework
A deep dive into Nous Research's Hermes Agent open-source AI framework and the community Orange Book guide covering tool calling, reasoning, multi-Agent collaboration, and more.
Read more →