Unverified60% confidenceFactExact time
During the Decode phase of large models, because each step depends on the result of the previous step and can only be executed serially, hardware utilization is typically below 10%.
2
Sources
60%
Confidence
Long-term
Relevance
5/29/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedDuring the autoregressive decoding phase, GPU compute utilization is often less than 10%, making it a memory-intensive operation.71% similarUnverifiedDiffusion models typically require 20–50 sampling steps, whereas Transformer-based masked generation methods can compress inference steps to fewer than 10.69% similarUnverified研究表明当ReAct循环超过10步时，模型的任务完成率会出现显著下降69% similarUnverifiedAfter offloading half of the model layers to system memory, the generation speed often drops sharply from over ten tokens per second to single digits.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1257API
curl https://kongchang.com/api/v1/knowledge/claims/1257MCP
get_claim(id=1257)