Unverified50% confidenceDecision RuleExact time
对流式响应场景，应重点关注首Token延迟（TTFT）而非整体完成时间
1
Sources
50%
Confidence
Long-term
Relevance
7/20/2026
First Seen
Sources
Related Claims
Unverified推理延迟通常分解为首token延迟（TTFT）和后续token生成吞吐量两个核心指标81% similarUnverified如果流式响应的超时阈值设置不当，客户端可能因超时判定而提前终止响应流，GLM在推理链路耗时较长时更容易触发超时机制70% similarUnverified传统混合部署中Prefill阶段的大批量计算会阻塞Decode阶段的token生成，导致TTFT波动剧烈67% similarUnverified带时间窗的旅行商问题（TSPTW）是行程规划涉及的经典组合优化问题67% similarUnverified需要临时加急处理（如次日取回）的场景不适合，固定周期取送模式无法灵活响应突发需求66% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/565595API
curl https://kongchang.com/api/v1/knowledge/claims/565595MCP
get_claim(id=565595)