Conceptvirtual key
Virtual Key
A credential abstraction mechanism in self-hosted LLM gateways, issued by administrators within the gateway. Each key can be bound to a budget ceiling, a list of permitted models and an expiry period, while the real upstream keys are kept inside the gateway.
Timeline (last 90 days)
Oct 15
By assigning fine-grained virtual keys to specific services at the gateway layer, teams can configure automatic rate limits and token budgets, enforcing budget thresholds before runaway costs accumulate.
Unverified50%