#LiteLLM
4 related articles
·2 min
LiteLLM in Practice: One Proxy to Rule All Your Local and Cloud LLMs
LiteLLM unifies local inference (Ollama, vLLM) and cloud APIs (OpenAI, Anthropic) into one OpenAI-compatible gateway, with waterfall routing, load balancing, and cost control for Homelab AI setups.
Read more →
·2 min
LiteLLM Smart Routing in Practice: Automatic Traffic Distribution Between Large and Small Local LLMs
LiteLLM as a unified gateway for local LLMs: automatic routing between large and small models. Covers heuristic vs. LLM classifiers, Ollama/MLX setup, and Pi Coding Agent integration.
Read more →
Tutorials·3 min
Claude Agent SDK + LiteLLM + Local LLMs: Building a Zero-Cost AI Agent Platform
Learn how to redirect Claude Agent SDK API requests to local LLMs via LiteLLM Proxy, achieving zero-cost inference while retaining full agent framework capabilities.
Read more →
Product Reviews·3 min
LiteLLM: A Deep Dive into the Open-Source Gateway for 100+ LLM APIs
Deep dive into LiteLLM, the open-source AI gateway supporting 100+ LLM APIs with a unified OpenAI format. Covers core features, usage modes, and enterprise use cases.
Read more →