#LLM middleware
194 related articles
·3 min
LangChain v1.3 Hands-On Tutorial: Deep Dive into Agents, RAG, and Local Model Deployment
Deep dive into LangChain v1.3: compare LangChain, LangGraph, and DeepAgent paradigms, explore RAG pipelines, multi-agent systems, and local LLM deployment for enterprise AI apps.
Read more →
·3 min
Dify for Beginners: A Complete Guide to Building AI Applications
A beginner's guide to Dify covering Docker deployment, MySQL setup, model integration, five app types (Chatbot/Agent/Workflow), and publishing — build LLM apps fast.
Read more →
·3 min
Dify Getting Started: A Complete Zero-to-Production Guide for Building AI Applications
A complete guide to Dify — covering deployment, five core app types (chatbot, Agent, workflow, and more), LLM integration, and publishing for zero-experience developers.
Read more →
·2 min
Spring AI Alibaba Admin: A Deep Dive into the Java Visual AI Workflow Platform
Spring AI Alibaba Admin is a visual AI workflow platform for Java, comparable to Dify. It supports Dify-to-Graph migration, multi-model integration, and code export. This article covers core features and local deployment tips.
Read more →
·2 min
AI Infrastructure or App Feature? The Architecture Debate Sparked by CogniCore
CogniCore asks: should persistent memory, context engines, and state management be standalone AI infrastructure or in-app features? A deep dive into 5 key directions and the missing middleware of the agent era.
Read more →
DCG: A Rust-Powered Safety Guard That …
·2 min
DCG: A Rust-Powered Safety Guard That Intercepts Dangerous AI Agent Commands
DCG is an open-source Rust tool that intercepts dangerous shell and git commands for AI agents like Claude Code and Cursor, enabling zero-trust execution environments.
Read more →
·3 min
Agent Infinite Loop Engineering Guide: Detection, Breaking, and Root Cause Analysis
How to handle Agent infinite loops? This guide covers three-layer loop detection, four strategy-switching techniques, root cause analysis, and multi-layer fallbacks for building stable, production-grade Agent systems.
Read more →
·3 min
Java Developers Pivoting to AI: Why RAG Knowledge Bases Are the Best Entry Point
Traditional Java roles are shrinking while AI demand surges. Learn the three paths into AI for developers, and why RAG knowledge bases are the highest-ROI entry point for Java engineers.
Read more →
·6 min
OpenAI vs Anthropic IPO Race: Who's Really Burning Cash? A Deep Dive Into AI Giants' Finances
OpenAI's adjusted operating margin hits -122%, Anthropic's profitability remains murky, and SpaceX claims a $22.7T AI market. A deep dive into three AI giants' real financials and the capital game behind the IPO race.
Read more →
GitHub Daily · July 18: 3D Reconstruct…
·3 min
GitHub Daily · July 18: 3D Reconstruction Foundation Model Tops the Charts, AI Engineering and CLI Agents Explode Collectively
July 18 GitHub Daily: 3D reconstruction foundation model lingbot-map tops the charts, with AI engineering tooling, CLI Agents, and the MCP ecosystem exploding across the board.
Read more →
·2 min
WhatsApp AI Agent in Action: A Complete Service Pipeline for Online Courses
Learn how to build a full WhatsApp AI Agent pipeline for online courses — from ad-driven lead capture and smart screening to automated service delivery and silent lead re-engagement.
Read more →
·2 min
Forge: Adding Reliability Guardrails to Local Model Tool Calling
Forge is an open-source Python middleware for local models (Ollama, llama.cpp, vLLM) that boosts tool-calling reliability via three-layer guardrails: validation, rescue parsing, and retry.
Read more →
·3 min
ASE Control Panel: How STATE_SYNC Tokens Enable AI State Persistence
A deep dive into ASE's core mechanism — the STATE_SYNC checkpoint token — and how it transforms stateless LLMs into stateful AI systems for complex multi-turn workflows.
Read more →
·3 min
Complete Guide to Deploying LLMs Locally on RobotCore Mini: From Ollama Installation to Web Interface Setup
A complete guide to deploying LLMs locally on RobotCore Mini using Ollama — covering model pulling, CLI verification, Web backend setup, and LAN access.
Read more →
·2 min
llama.cpp Milestone: The Open-Source Evolution of Local LLM Inference
llama.cpp hits a new milestone, growing from a solo hobby project into core local AI inference infrastructure. Explore its iteration speed, GGUF quantization, and how AI coding agents are reshaping open-source development.
Read more →
·3 min
Perplexity AI Deep Dive: The Perfect Fusion of Search Engine and AI Q&A
Deep dive into Perplexity AI: real-time web search + multi-model AI, transparent citations, Focus Modes, PDF chat, and collaborative Collections. Can it replace Google and ChatGPT?
Read more →
·3 min
Render Code as Images and Send to Claude — Cut API Costs by 70%
PXPipe renders system prompts and tool docs as images sent to Claude, exploiting visual token pricing. Real-world results: 68% fewer input tokens, 59–70% lower bills.
Read more →
·3 min
Vibe Coding in Practice: A Comprehensive Review and Selection Guide for 6 AI Coding Tools
In-depth comparison of 6 Vibe Coding tools — Claude Code, Trae, Zhipu, Cursor, and more — covering setup cost, Chinese support, pricing, and code quality.
Read more →
·3 min
AI Agents Gone Rogue: Why They Burn Through Your API Budget and How to Stop Them
An orchestration Agent looped for hours, firing thousands of LLM calls and burning weeks of budget. Learn the root causes and practical defenses: circuit breakers, tiered budgets, and iteration limits.
Read more →
LLM Evaluation Tools Compared: An In-D…
·3 min
LLM Evaluation Tools Compared: An In-Depth Look at LangSmith, Langfuse, and Three More
Deep comparison of LangSmith, Langfuse, Phoenix, Braintrust, and Galileo across self-hosting, open-source licensing, and real-time guardrails to find the best LLM eval tool for production.
Read more →