Unverified85% confidenceFactExact time
传统混合部署中Prefill阶段的大批量计算会阻塞Decode阶段的token生成，导致TTFT波动剧烈
1
Sources
85%
Confidence
Long-term
Relevance
5/21/2026
First Seen
Sources
Tutorial: Deploying a PD-Disaggregated SGLang Multi-Node Inference Cluster on AMD GPUs
twitterlmsysorg5/21/2026
Related Entities
Related Claims
UnverifiedTTFT is determined by the Prefill phase and is compute-bound, while TPOT corresponds to the Decode phase and is memory-bandwidth-bound.77% similarUnverifiedInference latency is typically decomposed into two core metrics: time to first token (TTFT) and subsequent token generation throughput.76% similarUnverifiedLLM推理的prefill阶段并行处理输入所有token并生成初始KV Cache，是计算密集型操作，是TTFT的直接决定因素73% similarUnverified缓存命中时prefill阶段可跳过已缓存部分，TTFT可从数秒压缩至毫秒级69% similarUnverifiedThe Prefill phase is a compute-intensive operation, while the Decode phase is a memory-bandwidth-intensive operation.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/557API
curl https://kongchang.com/api/v1/knowledge/claims/557MCP
get_claim(id=557)