Unverified50% confidenceFactExact time
Inter-token latency (ITL) is the time interval between adjacent tokens during the generation process and determines the smoothness of streaming text output.
1
Sources
50%
Confidence
Long-term
Relevance
9/18/2026
First Seen
Sources
Related Entities
Related Claims
Unverified文本生成阶段是memory-bound问题，速度受限于内存带宽；预填充阶段是compute-bound场景，可高度并行化61% similarUnverified语言模型生成 token 本质上是内存带宽受限任务而非纯算力受限59% similarVerifiedLarge language model text generation is an autoregressive serial process that produces only one token at a time, making it impossible to fully parallelize the output stage, with higher computational intensity than the input encoding stage.59% similarUnverified输入Token可以在prefill阶段并行处理，而输出Token必须在decode阶段逐个串行生成58% similarUnverifiedProsodic event textualization encodes prosodic events such as pauses and word lengthening as explicit tokens, and uses a duration-aware bounded repetition mechanism to represent event intensity.57% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/933097API
curl https://kongchang.com/api/v1/knowledge/claims/933097MCP
get_claim(id=933097)