Verified90% confidenceFactExact time
The Prefill phase is a compute-intensive operation, while the Decode phase is a memory-bandwidth-intensive operation.
6
Sources
90%
Confidence
Long-term
Relevance
7/12/2026
First Seen
Sources
Related Claims
UnverifiedThe decode phase is a memory-bandwidth-intensive operation, and overall throughput is constrained by VRAM bandwidth rather than compute.83% similarUnverifiedLLM inference requests are divided into two phases—Prefill (input) and Decode (output); Prefill can read inputs in parallel with extremely high throughput, while Decode requires token-by-token serial inference and occupies significantly more GPU time.77% similarUnverified输出Token定价高于输入Token是因为Prefill阶段可并行矩阵运算而Decode阶段必须串行自回归解码，Decode阶段GPU吞吐量约为Prefill阶段的1/6到1/1075% similarUnverifiedAt the hardware level, the Prefill (input) stage can read all tokens in parallel and compute the self-attention matrix simultaneously, whereas the Decode (output) stage requires serial autoregressive token-by-token inference, causing GPU utilization to drop sharply.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/489344API
curl https://kongchang.com/api/v1/knowledge/claims/489344MCP
get_claim(id=489344)