#inference engine
3268 related articles
Tutorials·3 min
awesome-llm-apps: A 100K-Star GitHub Project with 100+ AI Agent & RAG Applications
awesome-llm-apps is a 100K+ Star GitHub project featuring 100+ ready-to-run AI Agent and RAG apps. Built in Python with clone-and-run simplicity, it's an essential resource for LLM developers.
Read more →
Product Reviews·3 min
MiroFlow Open-Source AI Workflow Framework Review: The Strengths and Concerns Behind Top Rankings Across Multiple Benchmarks
In-depth review of MiroFlow open-source AI workflow framework: technical architecture behind 5+ benchmark Top-1 rankings, multi-model support, Web UI, and comparison with LangChain and Dify.
Read more →
Product Reviews·3 min
PyGPT: Open-Source Desktop AI Assistant with All-in-One Integration of GPT, Claude, Ollama, and More
Deep dive into PyGPT, an open-source desktop AI assistant supporting GPT-4, Claude, Gemini, Ollama local models, with built-in RAG, agents, voice interaction, and image generation.
Read more →
Product Reviews·2 min
Opik: An Open-Source LLM Observability Platform for Debugging, Evaluation, and Monitoring All in One Place
Deep dive into Opik: an open-source platform for LLM app lifecycle management with tracing, automated evaluation, hallucination detection, and production monitoring for RAG and Agent workflows.
Read more →
Product Reviews·2 min
Opik: Open-Source LLM Observability Platform for Debugging, Evaluation, and Monitoring All in One
Deep dive into Opik: an open-source platform for LLM app lifecycle management with tracing, automated evaluation, hallucination detection, and production monitoring. 19K+ GitHub stars.
Read more →
Product Reviews·3 min
LiteLLM: A Deep Dive into the Open-Source Gateway for 100+ LLM APIs
Deep dive into LiteLLM, the open-source AI gateway supporting 100+ LLM APIs with a unified OpenAI format. Covers core features, usage modes, and enterprise use cases.
Read more →
Product Reviews·3 min
AI Coding Agent Benchmark: Comprehensive Ranking and Selection Guide for 80+ Tools
Comprehensive comparison of 80+ AI coding agent tools, with SWE-Bench benchmark rankings covering Devin, Cursor, Claude Code, GitHub Copilot and more, plus pricing analysis to help developers choose.
Read more →
Tutorials·2 min
7000+ Lines of AI Tool System Prompts: Deep Dive into an Open-Source Project with Practical Guide
Deep dive into the open-source project system-prompts-and-models-of-ai-tools: 7000+ lines of system prompts from ChatGPT, Claude & more, covering prompt engineering best practices and safety design.
Read more →
Expert Opinions·3 min
Reinventing the Wheel: Why Building From Scratch Is the Shortcut to the Technical Frontier
Developer Andrew Quinn compressed a 3GB SQLite database into a 7MB FST file, sharing a profound insight: reinventing four or five wheels by hand beats passive study at pushing you to the technical frontier.
Read more →
Tutorials·3 min
Hands-On Intelligent Agent Development with LangGraph: From Getting Started to Full Project Architecture
A deep dive into intelligent Agent development with LangGraph, covering core concepts, project architecture, state management, and practical tips for building AI agents in Python.
Read more →
Product Reviews·3 min
Deep Dive into AGGO Framework: A New Go-Based Choice for Enterprise AI Agents
Deep dive into AGGO—an enterprise AI Agent framework built with Go and CloudWeGo Eino, covering conversational AI, RAG, memory systems, and tool calling, with Go's performance advantages.
Read more →
Tutorials·3 min
LangGraph E-commerce AI Agent in Practice: From RAG Q&A to Automated Return Workflows
Deep dive into the E-commerce-Smart-Agent open-source framework built with LangGraph and FastAPI, covering RAG knowledge base Q&A, return workflow automation, and graph-based orchestration.
Read more →
Product Reviews·2 min
Lingque AI Agent Framework: A Self-Controlled Solution for Private Deployment
Lingque is a Python-based open-source AI Agent framework supporting fully private deployment with data sovereignty. This article analyzes its technical features, use cases, and advantages over LangChain.
Read more →
Product Reviews·3 min
Micro-Agent: Fudan University's Open-Source Lightweight AI Agent Framework Built for Vertical Domains
Micro-Agent is a lightweight AI Agent framework open-sourced by Fudan University, focused on vertical domain applications. It offers streamlined architecture, low learning costs, and high customization flexibility compared to heavyweight frameworks like LangChain.
Read more →
Product Reviews·2 min
Fay Open-Source Agent Framework: The Connection Layer Between Digital Humans and Business Systems
Fay is an open-source Agent framework with 12,700+ GitHub Stars, connecting digital humans, LLMs like DeepSeek, and enterprise systems for customer service, virtual streaming, and more.
Read more →
Product Reviews·3 min
Agentica Open-Source Framework Review: A Lightweight Async AI Agent Development Alternative
In-depth review of Agentica, an open-source AI Agent framework featuring async-first architecture, tool calling, RAG, multi-agent collaboration, and MCP protocol support, with comparisons to LangChain and other mainstream frameworks.
Read more →
Tutorials·3 min
Hermes Agent Orange Book: A Practical Guide to the 3600+ Star Open-Source AI Agent Framework
A deep dive into Nous Research's Hermes Agent open-source AI framework and the community Orange Book guide covering tool calling, reasoning, multi-Agent collaboration, and more.
Read more →
Deep Dives·4 min
Deep Dive into Claude Code Source Code: A Complete Guide to Agent Loops, Context Engineering, and Architecture Design
Deep analysis of Claude Code's source architecture: Agent loop mechanism, context engineering strategies, tool system design, and permission controls. Based on the viral GitHub project how-claude-code-works.
Read more →
Product Reviews·3 min
Datus-agent: An AI-Native CLI Tool Reshaping Data Engineering with Context Engineering
Deep dive into Datus-agent, an open-source AI-native CLI SQL client that brings Context Engineering to data engineering with natural language queries and modern data stack support.
Read more →
Product Reviews·4 min
cased/kit: An Open-Source Toolkit for Context Engineering in AI Coding — Code Search and Symbol Extraction
cased/kit is an open-source Python toolkit for context engineering, providing AI coding assistants with codebase mapping, symbol extraction, and multi-mode code search capabilities.
Read more →