Unverified50% confidenceFactExact time
Both OpenAI's Prompt Caching and Anthropic's Prompt Caching adopt a KV cache reuse mechanism.
1
Sources
50%
Confidence
Long-term
Relevance
9/18/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedPrefix Caching technology persistently stores already-computed KV vectors on the server side, allowing direct reuse when new requests share a large number of repeated prefixes with previous requests, with the matched portion billed at the cache price.74% similarUnverifiedThe caching mechanism is technically commonly referred to as KV Cache or Prompt Caching73% similarUnverifiedAnthropic's Prompt Caching leverages the KV Cache mechanism in the Transformer architecture to reduce latency and cost by caching the key-value states corresponding to shared prompt prefixes.72% similarUnverifiedIn the Prompt Cache mechanism, when the prefix content of an API request is identical to a previous one, the system reuses the already-computed KV cache to complete cache reads at a lower price, while cache write is the billing item for the first time content is written into the cache.71% similarUnverifiedvLLM的前缀缓存（Prefix Caching）对KV Cache块计算哈希值，当新请求输入前缀与已缓存请求重叠时直接复用物理缓存块，跳过该部分prefill计算70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/932473API
curl https://kongchang.com/api/v1/knowledge/claims/932473MCP
get_claim(id=932473)