Unverified50% confidenceFactExact time
Prefill is one of the two stages of large language model inference, the other being decode; the prefill stage processes the entire prompt in parallel and computes the KV Cache.
1
Sources
50%
Confidence
Long-term
Relevance
11/9/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedThe Prefill phase is a compute-intensive operation, while the Decode phase is a memory-bandwidth-intensive operation.80% similarUnverifiedThe prefill phase performs one forward computation over the entire input to produce KV caches for all positions, and is compute-bound; the decode phase generates tokens autoregressively one by one and is memory-bandwidth-bound.77% similarUnverifiedPrefill is the first stage of large language model inference, in which the model reads the entire prompt entered by the user in one pass and computes key-value vectors for each token and stores them in VRAM.76% similarUnverifiedThe inference process of large language models is divided into two phases, Prefill and Decode, and the computational complexity of the attention mechanism is O(n²).75% similarUnverifiedPrefilling refers to when, in using a large language model API, the caller pre-provides a piece of text (or token sequence) for the model to continue generating from, rather than starting from an empty context.75% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1152737API
curl https://kongchang.com/api/v1/knowledge/claims/1152737MCP
get_claim(id=1152737)