Unverified50% confidenceBenchmarkExact time
本地推理的首 token 延迟通常在 100-500ms，而云端 API 在网络良好时需要 500-2000ms 的首 token 延迟
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
8/13/2026
First Seen
Valid until: 11/11/2026
Sources
Related Claims
UnverifiedAgora的SD-RTN覆盖全球200+数据中心，端到端延迟通常控制在400ms以内69% similarVerifiedCurrent mainstream AI programming tools have context window limitations, typically ranging from 8K to 200K tokens.66% similarUnverifiedUnder a 4×RTX 3090 SXM4 configuration, the quantized version of GLM-5.2 achieves a token generation speed of approximately 6.3–6.8 tokens/second and a prompt evaluation speed of approximately 10.6 tokens/second.64% similarUnverifiedLocally running open-source LLM models typically have a context capacity of only 4K to 32K tokens, limited by hardware memory.62% similarUnverified传统数据库即使是内存数据库，通常也需要微秒级别的查询时间，Redis等方案仍需经过网络栈（约50-200微秒）61% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/742231API
curl https://kongchang.com/api/v1/knowledge/claims/742231MCP
get_claim(id=742231)