#OpenTelemetry LLM
62 related articles
·3 min
TraceLLM: An Open-Source LLM Observability Platform Built on OpenTelemetry
TraceLLM is an open-source observability platform for production AI apps, built on OpenTelemetry, offering Prompt tracing, Token monitoring, latency analysis, and full distributed tracing.
Read more →
·2 min
LangWatch Open-Source Tool: Making Every Token Cost in Claude Code Crystal Clear
LangWatch launches an open-source tool for Claude Code usage tracking — one command to trace token consumption, cache breakdowns, call chains, and terminal replay to optimize AI coding costs.
Read more →
·3 min
The "200 OK" Trap: AI Agents' Most Dangerous Silent Failure Mode
Deep analysis of the dangerous disconnect between HTTP 200 OK and actual business outcomes in AI Agent workflows, with solutions for building reliable production-grade Agent systems.
Read more →
·3 min
The "200 OK" Trap: AI Agents' Most Dangerous Silent Failure Mode
Deep analysis of the dangerous disconnect between HTTP 200 OK and actual business results in AI Agent workflows, with solutions for building reliable production-grade Agent systems.
Read more →
·4 min
Infrastructure Architecture for Agent Applications: Four Core Patterns Explained
A deep dive into infrastructure architecture patterns for production-grade Agent applications, covering state persistence, sandbox isolation, LLM observability, and cost control.
Read more →
·4 min
Infrastructure Architecture for Agent Applications: Four Core Patterns Explained
Deep dive into infrastructure architecture patterns for production-grade Agent applications, covering state persistence, sandbox isolation, LLM observability, and cost control.
Read more →
·3 min
LLMOps Tool Selection Guide: An In-Depth Comparison of Tracing, Evaluation, and Governance Capabilities
In-depth analysis of LLMOps tool selection, comparing Langfuse, LangSmith, Helicone, and Orq.ai across tracing, evaluation, and governance capabilities with practical recommendations.
Read more →
·5 min
Complete Breakdown of Core Competencies for AI Agent Engineers: From Demo to Production-Grade Systems
Deep breakdown of 4 core AI Agent engineer competencies: business decomposition, multi-Agent architecture, quantitative evaluation, and engineering delivery—bridging the gap from Demo to production.
Read more →
·3 min
API Mock vs. Sandbox in Agent Testing: A Detailed Layered Strategy Guide
API Mock is fast but misses bugs; Sandbox is realistic but costly. This article analyzes their core differences and provides a layered testing strategy for building reliable Agent test systems.
Read more →
·2 min
The New Bar for AI/LLM Roles: A Practical Guide to Agent Observability and Evaluation
Enterprise AI/LLM roles now demand engineering skills: streaming recovery, high concurrency, multi-tenancy, LLM gateways, Langfuse observability, and evaluation platforms. Master these 8 core competencies.
Read more →
·3 min
Pinterest Medic: Engineering an AI Agent for Automated Spark Failure Diagnosis
How Pinterest engineers built Medic for Apache Spark — a multi-agent auto-diagnosis tool — covering the evolution from a single ReAct agent, observability, log denoising, and end-to-end testing.
Read more →
Mindwalk: Replaying AI Coding Agent Be…
·4 min
Mindwalk: Replaying AI Coding Agent Behavior on a 3D Code Map
Mindwalk renders codebases as 3D maps, visually replaying the full operation trajectories of AI coding agents like Claude Code and Cursor. A deep dive into its core ideas, use cases, and the future of agent observability tools.
Read more →
·7 min
The Complete Guide to LLM Application Engineer Interviews: Six High-Frequency Topics in the Agent Domain
A focused guide to the core interview topics for LLM application engineers, covering agent architecture, Multi-Agent, Langfuse evaluation & tracing, security, and RAG optimization.
Read more →
·7 min
The Complete Guide to LLM Application Engineer Interviews: Six High-Frequency Agent Topics
A focused guide to core LLM application engineer interview topics, covering agent architecture, Multi-Agent, Langfuse evaluation, security, and RAG optimization.
Read more →
·2 min
Spring AI Alibaba Admin: A Deep Dive into the Java Visual AI Workflow Platform
Spring AI Alibaba Admin is a visual AI workflow platform for Java, comparable to Dify. It supports Dify-to-Graph migration, multi-model integration, and code export. This article covers core features and local deployment tips.
Read more →
·2 min
From Workflow Graphs to Distributed Protocols: Dissecting Multi-Agent System Architecture Paradigms
How does Cosmonapse replace LangGraph's graph structure with event-driven distributed protocols? A deep dive into two multi-agent architecture paradigms, their trade-offs, and when to use each.
Read more →
·3 min
Cosmonapse: A Decentralized Multi-Agent Framework Built on an Event Bus
Cosmonapse is an open-source multi-agent framework that replaces central orchestrators with peer nodes, using typed signals and an event bus to fully decouple tool calls, memory, and HITL. Supports Python and TypeScript under Apache 2.0.
Read more →
·2 min
AI Agent Debugging Bottlenecks: A Practical Guide to Production Observability
Explore core AI Agent debugging challenges in production: non-determinism, multi-step error propagation, and observability gaps — with practical guidance on LangSmith and tracing tools.
Read more →
Production-Grade LangGraph Template: A…
·2 min
Production-Grade LangGraph Template: A Practical Guide to Engineering AI Agents for Production
A deep dive into production-grade LangGraph templates covering state management, observability, error handling, and containerized deployment to bridge the gap from demo to production.
Read more →
·3 min
Core Iron Rules for Deploying AI Agents in Production
What are the critical runtime rules for AI Agents in production? This deep dive covers independent verification for state changes, least privilege, observability, and more.
Read more →