ConceptInstrumentation
Instrumentation Logging
An engineering practice of collecting structured minimal metadata at the gateway layer for each LLM request, such as token length, tool-calling schema, output constraints, template ID, and human acceptance rate, in order to characterize a request's difficulty fingerprint.
Timeline (last 90 days)
Oct 16
Before building a router, instrumentation should be done first, collecting structured metadata such as the request's prompt length, context size, whether a tool call is requested, whether the output is constrained by a schema, and whether a human accepts the result; usually two weeks of data is enough to judge whether routing is worth doing.
Unverified50%