Unverified50% confidenceFactExact time
Decode 阶段属于访存密集型操作，每生成一个新 token 需从显存读取全部历史 token 的 KV Cache
1
Sources
50%
Confidence
Long-term
Relevance
7/22/2026
First Seen
Sources
Related Claims
UnverifiedThe decode phase is a memory-bandwidth-intensive operation, and overall throughput is constrained by VRAM bandwidth rather than compute.71% similarUnverifiedThe KV Cache mechanism can cache repeated prefix content, and the more concise the system prompt, the higher the cache hit rate.71% similarUnverified生成式AI推理中的自回归解码本质上是内存带宽受限（Memory-Bound）的操作，每次生成Token需读取全部KV Cache67% similarUnverifiedConstrained Decoding computes the set of valid tokens at each token step of autoregressive generation based on a finite state machine or context-free grammar and renormalizes the probabilities, mathematically guaranteeing that the output conforms to the target schema.67% similarUnverified输出Token定价高于输入Token是因为Prefill阶段可并行矩阵运算而Decode阶段必须串行自回归解码，Decode阶段GPU吞吐量约为Prefill阶段的1/6到1/1065% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/585471API
curl https://kongchang.com/api/v1/knowledge/claims/585471MCP
get_claim(id=585471)