#Portkey
33 related articles
·3 min
OpenRouter Alternatives: A Complete Guide to LLM Gateway Selection
Compare OpenRouter alternatives including LiteLLM, Portkey, AWS Bedrock, and more. A complete guide to choosing the right LLM gateway for data privacy, cost control, and architectural flexibility.
Read more →
·4 min
Build or Buy LLM Infrastructure? A 7-Month Hands-On Retrospective Reveals the Hidden Costs
A 7-month retrospective on building LLM infrastructure from scratch: hidden costs of routing, fallback, evals, and a comparison of orq.ai, LangSmith, Helicone, Portkey, and LiteLLM.
Read more →
·2 min
OpenRouter Acquired by Stripe: Strategic Integration of an AI Model Gateway with a Payments Giant
OpenRouter joins Stripe in a strategic acquisition merging AI model gateway capabilities with payment infrastructure. Analysis of the business logic, community reactions, and impact on AI infrastructure.
Read more →
·2 min
Culpa: A Cost Analysis Tool That Traces Every AI Dollar Back to a Specific Conversation
Culpa is an AI cost observability tool that traces every AI dollar to specific users, features, and conversations. With cost prediction and local-first architecture, it helps teams diagnose cost spikes and drive data-informed pricing.
Read more →
·2 min
Stripe Acquires OpenRouter: What a $7 Billion Bet on AI Infrastructure Means
Stripe acquires AI model routing platform OpenRouter for over $7B, extending from payments into AI metering infrastructure. Deep dive into the strategic logic, community debate, and implications.
Read more →
·2 min
Inferock Bench: An Open-Source Cost Auditing Tool That Issues an Independent Receipt for Every LLM Call
Inferock Bench is an open-source LLM cost auditing tool that uses a local proxy to intercept API calls, precisely tracking token usage, failures, and retry costs per request to help developers identify hidden overspending.
Read more →
·2 min
oqoqo: A Developer Tool for Building Custom AI Evaluation Benchmarks with Real-World Tasks
oqoqo is a developer-focused AI evaluation tool for building private benchmarks, measuring Agent performance on real products, and optimizing model selection across GPT, Claude, and Gemini.
Read more →
·3 min
GLM-5.2 Unavailable — What Happened? A Deep Dive into AI Model Fallback Mechanisms
Users report GLM-5.2 being silently replaced by a Best model. Learn how AI platform fallback mechanisms work, why they trigger, and how to handle silent model switching.
Read more →
·4 min
How Databricks Cut AI Coding Costs by 70%: Strategies and Insights
Databricks cut AI coding tool costs by 70% through intelligent model routing, prompt caching, context optimization, and self-hosted open-source models. Learn actionable strategies for controlling LLM inference costs.
Read more →
·3 min
ngrok AI Gateway: One Private Gateway to Rule All AI Models
Deep dive into how ngrok AI Gateway manages OpenAI, Anthropic, and self-hosted models through unified keys and entry points, delivering observability, access control, and fallbacks for production AI.
Read more →
·2 min
LangSmith Gateway Explained: Core Capabilities and Architecture of LangChain's Enterprise AI Model Gateway
Deep dive into LangSmith Gateway's core features including cost control, rate limiting, PII redaction, coding agent integration, and open-source model access for enterprise AI infrastructure.
Read more →
·2 min
CostPerPrompt: A Deep Dive into Real-Time AI API Cost Estimation and Pricing Comparison
CostPerPrompt is a real-time AI API pricing comparison and cost estimation tool supporting OpenAI, Anthropic, Google and more, helping developers estimate monthly token costs based on real workloads.
Read more →
·4 min
Enterprise LLM Governance Implementation Guide: The Critical Difference Between Routing Control and Organizational Governance
In-depth analysis of enterprise LLM governance challenges, comparing real capabilities of Portkey, Orq.ai, LangSmith, Azure, and AWS Bedrock, revealing the critical divide between routing control and organizational governance.
Read more →
·3 min
LLM Cost Optimization in Practice: Balancing Savings with User Experience
Practical LLM cost optimization strategies covering Prompt trimming, context compression, and multi-model routing to cut Token costs while maintaining output quality at scale.
Read more →
·3 min
LLM Cost Optimization in Practice: Balancing Savings and User Experience
Practical strategies for LLM cost optimization: prompt trimming, context compression, multi-model routing, and more to cut token costs while maintaining output quality at scale.
Read more →
·2 min
The New Bar for AI/LLM Roles: A Practical Guide to Agent Observability and Evaluation
Enterprise AI/LLM roles now demand engineering skills: streaming recovery, high concurrency, multi-tenancy, LLM gateways, Langfuse observability, and evaluation platforms. Master these 8 core competencies.
Read more →
Intelligent Model Routing: The Core Te…
·3 min
Intelligent Model Routing: The Core Technology and Implementation Guide for AI Cost Reduction and Efficiency
Intelligent Model Routing is becoming key AI infrastructure. This article explores its principles, solution types, technical challenges, and implementation considerations to help developers balance cost, latency, and quality.
Read more →
·3 min
The Complete Guide to AI-Native Architecture: RAG, Agents, and MCP
A comprehensive guide to AI-native application architecture: LLM inference, RAG retrieval (vector DB/knowledge graph/BM25), Agents, MCP tool calling, AI gateways, and observability — end-to-end.
Read more →
·3 min
Introducing LLM Gateways in Production: Five Key Concerns and the Prerequisites for Trust
Introducing an LLM Gateway in LangChain production brings unified APIs and auto-fallback, but also quality drift, cost spikes, and debug black boxes. This article breaks down the five key engineering concerns and what it takes to earn trust.
Read more →
·5 min
Practical AI Cost Optimization: A Deep Dive into Intelligent Routing and Context Compaction
AI bills keep soaring? This article breaks down two core cost-reduction strategies: intelligent routing via an LLM Gateway, and context compaction to cut Token usage—no major refactoring needed.
Read more →