#LiteLLM Proxy
44 related articles
·3 min
LLMOps Tool Selection Guide: An In-Depth Comparison of Tracing, Evaluation, and Governance Capabilities
In-depth analysis of LLMOps tool selection, comparing Langfuse, LangSmith, Helicone, and Orq.ai across tracing, evaluation, and governance capabilities with practical recommendations.
Read more →
·4 min
Complete Guide: Connecting DeepSeek and Other Chinese LLMs to Codex
No ChatGPT account? No problem. Learn how to connect DeepSeek and other Chinese LLMs to Codex using the Codex++ management tool — including Base URL setup, API Key creation, and token top-up.
Read more →
·2 min
Stone+ Beginner's Guide: Set Up Your AI Coding Environment in 1 Minute
A complete Stone+ (StonePlus) setup guide covering environment scan, API config, proxy detection, model validation, and end-to-end verification. Get your AI coding environment running in 1 minute.
Read more →
·3 min
The Complete Guide to AI-Native Architecture: RAG, Agents, and MCP
A comprehensive guide to AI-native application architecture: LLM inference, RAG retrieval (vector DB/knowledge graph/BM25), Agents, MCP tool calling, AI gateways, and observability — end-to-end.
Read more →
·2 min
Getting Started with Codex: A Practical Guide to OpenAI's AI Coding Assistant
A practical guide to OpenAI Codex: core features, Codex vs. Claude Code comparison, and why the Codex+DeepSeek combo doesn't work. Avoid common pitfalls and boost your coding productivity.
Read more →
·3 min
Introducing LLM Gateways in Production: Five Key Concerns and the Prerequisites for Trust
Introducing an LLM Gateway in LangChain production brings unified APIs and auto-fallback, but also quality drift, cost spikes, and debug black boxes. This article breaks down the five key engineering concerns and what it takes to earn trust.
Read more →
LLM Evaluation Tools Compared: An In-D…
·3 min
LLM Evaluation Tools Compared: An In-Depth Look at LangSmith, Langfuse, and Three More
Deep comparison of LangSmith, Langfuse, Phoenix, Braintrust, and Galileo across self-hosting, open-source licensing, and real-time guardrails to find the best LLM eval tool for production.
Read more →
·5 min
Practical AI Cost Optimization: A Deep Dive into Intelligent Routing and Context Compaction
AI bills keep soaring? This article breaks down two core cost-reduction strategies: intelligent routing via an LLM Gateway, and context compaction to cut Token usage—no major refactoring needed.
Read more →
·5 min
Multi-Model Tiered Deployment: Is an AI Gateway Worth Adopting?
More teams are adopting multi-model tiered scheduling. AI gateways solve cross-vendor API management, automatic fallback, and cost tracking — but add a new abstraction layer. Learn when a gateway is worth it.
Read more →
·4 min
How to Connect DeepSeek to Claude Code: A Complete 4-Step Setup Guide for Users in China
Step-by-step guide to connecting DeepSeek to Claude Code via CC Switch — no VPN needed, start for just ¥10. Covers API Key setup, installation, model config, and a live demo.
Read more →
·4 min
Complete Guide: Connecting Claude Code to DeepSeek — Local Setup + VS Code Integration
A step-by-step guide to installing Claude Code locally on Windows and swapping its underlying model for the DeepSeek API—enabling low-cost AI coding with no VPN required. Covers Node.js setup, Claude Code config, and getting a DeepSeek API Key.
Read more →
·7 min
Fable AI Coding in Practice: Optimizing Reasoning Levels and Multi-Model Collaboration to Save Money
Hands-on guide: Use Anthropic's Fable model to optimize AI coding workflows — control reasoning levels, leverage Claude-Codex multi-model collaboration, and cut costs from thousands to $150.
Read more →
·7 min
Fable AI Coding in Practice: Optimizing Reasoning Levels and Multi-Model Collaboration to Cut Costs
How developer Theo used Anthropic's Fable model to rebuild his AI coding workflow — controlling reasoning levels, multi-model routing with Codex, and sub-agent orchestration to cut costs from thousands to $150.
Read more →
·7 min
HuggingFace Open-Sources ml-intern: An AI Engineer That Reads Papers and Trains Models Autonomously
Hugging Face's open-source ml-intern autonomously reads papers, writes training scripts, and finetunes LLMs, deeply integrating the HF ecosystem and smolagents. Explore its features and impact on ML careers.
Read more →
·5 min
Major Unsloth Update: NVFP4 Quantization Export and DeepSeek-V4 Training Support
Unsloth v0.1.48-beta released, adding NVFP4/FP8 quantization export, OpenAI-compatible API hot-swapping, 3-5x faster MoE training, and 1.3x faster GRPO, covering the full LLM fine-tuning, quantization, and local deployment pipeline.
Read more →
·7 min
Otari: A Comprehensive Look at the Open-Source LLM Control Plane Tool
An in-depth analysis of the open-source LLM control plane tool Otari—covering unified multi-model access, cost observability, and security compliance governance to help teams build manageable, production-grade AI infrastructure.
Read more →
·4 min
Complete Guide to Connecting External Models in Codex: Two Methods to Unlock Full Capabilities
Two methods for connecting external models to Codex: manually configure keys via relay services, or use the CC Tool to auto-bridge GPT, DeepSeek, and more. Covers auth/config files, CC Tool usage, and multi-model switching.
Read more →
·6 min
10 Billion Tokens in Practice: An In-Depth Review of Codex's Long-Horizon Engineering Capabilities
Creator Ajiang burned 10B Tokens on Codex to migrate cc-haha from Tauri 2 to Electron. A deep dive into Codex's long-horizon engineering, Computer Use, costs, and practical advice for developers.
Read more →
·6 min
Codex Beginner's Guide: Four Product Forms Explained, Plus Comparison with Claude Code and Cursor
In-depth analysis of OpenAI Codex's four usage forms, comparing Codex, Claude Code, and Cursor across price, stability, and frontend/backend fit to help developers choose the right AI programming tool.
Read more →
·7 min
Hermes Agent Deep Dive: An AI Agent Framework That Uses Fewer Tokens Than Open Cloud
Full comparison of Hermes Agent vs Open Cloud: lower token usage, 200+ model support, auto Skill encapsulation, WeChat/DingTalk integration. A cost-effective AI Agent alternative for long-term deployment.
Read more →