Unverified50% confidenceFactExact time
Prompt caching reuses already-computed KV cache on the server side and requires the context prefix of the previous request to be identical to the current one.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/10/2026
First Seen
Valid until: 1/8/2027
Sources
Related Entities
Related Claims
VerifiedKV Cache通过将已计算的键值对持久化存储,使相同Prompt前缀的后续请求可直接复用,跳过重复的矩阵运算80% similarVerifiedThe core principle of prompt caching is cross-request reuse of the KV Cache, where already-computed KV states can be cached and reused when multiple requests share the same prefix.76% similarUnverifiedPagedAttention supports multiple requests sharing the KV Cache of the same prefix (Prefix Caching).75% similarUnverifiedThe caching mechanism is technically commonly referred to as KV Cache or Prompt Caching72% similarUnverifiedvLLM的前缀缓存(Prefix Caching)对KV Cache块计算哈希值,当新请求输入前缀与已缓存请求重叠时直接复用物理缓存块,跳过该部分prefill计算69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/993945API
curl https://kongchang.com/api/v1/knowledge/claims/993945MCP
get_claim(id=993945)