Partially Verified65% confidenceFactTime unknown
LLM 推理分为预填充阶段(Prefill,计算密集型)和解码阶段(Decode,内存带宽密集型)两个阶段
3
Sources
65%
Confidence
Long-term
Relevance
6/1/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedLLM推理的prefill阶段并行处理输入所有token并生成初始KV Cache,是计算密集型操作,是TTFT的直接决定因素79% similarUnverifiedLLM自回归解码阶段每生成一个token都需从显存加载全量模型权重,批量较小时形成内存墙74% similarUnverifiedThe autoregressive decoding phase of LLMs is limited by memory bandwidth bottlenecks, as generating each token requires a complete traversal of the activated model weights.74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/18511API
curl https://kongchang.com/api/v1/knowledge/claims/18511MCP
get_claim(id=18511)