Unverified50% confidenceFactExact time
Cache Hit means that when the context prefix of a request is exactly the same as that of a previous request, the server can directly reuse the already-computed KV cache without re-inference, so the unit price can be as low as two cents.
1
Sources
50%
Confidence
Long-term
Relevance
11/18/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedCached input refers to pre-storing the same context on the server side so that subsequent requests can reuse the cache without repeated computation, and is billed at a lower price.78% similarUnverifiedThe first prompt cache request is still billed at full price, and cache writes are sometimes priced separately.70% similarUnverifiedCache hit is a billing optimization mechanism in large language model APIs, with rates typically only 1/4 or even lower than that of regular input tokens.69% similarUnverifiedCache hit rate refers to the proportion, in continuous conversations or repeated requests, in which the model provider caches and reuses context with the same prefix and bills it at a discounted price; in programming agent workflows, the higher the cache hit rate, the less actual token billing and the faster the response.69% similarUnverifiedPrompt caching allows vendors to cache the same repeated prefix in an Agent loop, with subsequent calls billed at the cache read price, in this example $0.20 versus $4 for input, 20 times cheaper.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1184069API
curl https://kongchang.com/api/v1/knowledge/claims/1184069MCP
get_claim(id=1184069)