Unverified50% confidenceFactExact time
Token caching (Prompt Caching) is a cost-optimization mechanism in large model APIs; when the same prefix appears repeatedly across multiple requests, the computation result can be cached and charged at a lower rate.
1
Sources
50%
Confidence
Long-term
Relevance
9/30/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedCached input refers to pre-storing the same context on the server side so that subsequent requests can reuse the cache without repeated computation, and is billed at a lower price.79% similarVerifiedThe Prompt Caching mechanism can reuse the KV Cache of identical prefix contexts, typically reducing input token costs by 50%–90%.79% similarUnverifiedCache hit is a billing optimization mechanism in large language model APIs, with rates typically only 1/4 or even lower than that of regular input tokens.79% similarUnverifiedAnthropic的Prompt Caching功能对请求中的固定前缀部分若能复用缓存，则对相应Token给予折扣77% similarVerifiedIn API billing, the unit price of output tokens is generally higher than that of input tokens, because the generation process requires autoregressive inference token by token76% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/962545API
curl https://kongchang.com/api/v1/knowledge/claims/962545MCP
get_claim(id=962545)