Unverified50% confidenceBenchmarkExact time
OGL-Mini runs on CPU with latency under 10 ms, 10-30 times faster than external APIs, which add 100-300 ms of latency due to network requests.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/14/2026
First Seen
Valid until: 1/12/2027
Sources
Related Entities
Related Claims
Unverified本地推理的首 token 延迟通常在 100-500ms，而云端 API 在网络良好时需要 500-2000ms 的首 token 延迟64% similarUnverifiedTabPFN v2, which has a relatively small parameter count, can run on an ordinary laptop CPU with millisecond-level latency.64% similarUnverifiedAgora的SD-RTN覆盖全球200+数据中心，端到端延迟通常控制在400ms以内63% similarUnverified纯内存操作的延迟通常比向量数据库方案低1-2个数量级，Redis等内存数据库的P99延迟可控制在1ms以内，而远程向量检索往往需要10-100ms63% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1031440API
curl https://kongchang.com/api/v1/knowledge/claims/1031440MCP
get_claim(id=1031440)