Unverified50% confidenceFactExact time
The prefill stage is the process in which the model builds a key-value cache (KV Cache) for all input tokens when processing user input.
1
Sources
50%
Confidence
Long-term
Relevance
10/26/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe prefill stage is responsible for processing the input prompt, completing the KV cache computation for all input tokens in one pass; the decode stage generates new tokens one by one.79% similarUnverifiedThe prefill phase processes the complete input context, computes attention for all input tokens, and generates the KV cache; it is a compute-intensive operation whose time consumption is strongly correlated with input length.78% similarUnverifiedThe prefill phase requires processing all input tokens at once and is a compute-intensive operation, whereas the decode phase generates only one token per step and is a memory-bandwidth-intensive operation.73% similarUnverifiedvLLM的前缀缓存（Prefix Caching）对KV Cache块计算哈希值，当新请求输入前缀与已缓存请求重叠时直接复用物理缓存块，跳过该部分prefill计算73% similarUnverifiedCache Read is a billing and optimization mechanism in large language model APIs: when the prefix of a request is exactly identical to that of a previous request, the provider can directly reuse the already-computed key-value cache (KV Cache) without rerunning attention computation.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1098943API
curl https://kongchang.com/api/v1/knowledge/claims/1098943MCP
get_claim(id=1098943)