Escalation Routing

Escalation routing is an LLM routing strategy that starts at a low-cost model tier and escalates step by step to higher-tier models when the inference budget is exceeded. It is characterized by very low decision cost and fail-safe behavior, since in the worst case the request still ultimately reaches a large model.