Unverified50% confidenceFactExact time
Prompt Caching is a cost-optimization mechanism introduced by mainstream LLM providers (such as Anthropic and OpenAI): when the prefix portion of multiple requests is completely identical, the provider caches that portion of the computation, and tokens that hit the cache are billed at a price far below normal input.
1
Sources
50%
Confidence
Long-term
Relevance
10/12/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedToken caching (Prompt Caching) is a cost-optimization mechanism in large model APIs; when the same prefix appears repeatedly across multiple requests, the computation result can be cached and charged at a lower rate.78% similarUnverifiedOpenAI provides a Prompt Caching mechanism for models such as Codex, which allows reuse of previously computed KV cache when the prefix token sequence of a request is identical to a prior one, reducing the billing price for that portion (typically 50% or even lower than the normal price).76% similarVerifiedOpenAI Prompt Caching can reduce the cost of repeated prefixes to 10%–25% of the original price.76% similarUnverifiedAnthropic的Prompt Caching功能对请求中的固定前缀部分若能复用缓存，则对相应Token给予折扣74% similarUnverifiedThe current pricing systems of mainstream LLM APIs are usually composed of several dimensions: per-token billing (distinguishing input/output), per-call billing, tiered pricing, and cache-hit discounts.73% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1011773API
curl https://kongchang.com/api/v1/knowledge/claims/1011773MCP
get_claim(id=1011773)