Unverified50% confidenceBenchmarkExact time
Under the same hardware conditions, the fast model qwen2.5-coder:14b has a latency of about 2 seconds, about 500 tokens per answer, and a cost of about $5 per million answers; the thinking model deepseek-r1:14b has a latency of about 15 seconds, about 3000 tokens per answer, and a cost of about $30 per million answers; o1-class reasoning models have a latency of about 45 seconds, about 15000 tokens per answer, and a cost of about $150 per million answers.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
10/15/2026
First Seen
Valid until: 10/29/2026
Sources
Related Entities
Related Claims
UnverifiedIn a 40-turn conversation test using claude-sonnet-5 (input $0.3835/1M, output $1.5339/1M), the full-history strategy cost $0.001599 per message, a sliding window of the most recent 6 turns cost $0.000413 (about −74%), and summary plus the most recent 4 turns cost $0.000388 (about −76%).68% similarUnverified云端 AI 方案网络延迟往返时间通常在 200ms-2s,GPT-4 级别模型费用约 $30/百万 token;端侧方案本地推理可在 50-200ms 内完成首 token 生成且零边际成本68% similarUnverifiedIn a latency and cost comparison, Jev had a median latency of 443 milliseconds and a cost of approximately $71 per million messages; Gemini slightly exceeded 1 second at approximately $150; and GPT-5.5 reached 2.8 seconds at approximately $4,60067% similarUnverifiedDecision-1 has an average latency of 240ms, with 1380 calls costing about $0.015; gpt-4.1-nano has an average latency of 728ms and a cost of about $0.05-0.07; gpt-6.1-sol has an average latency of 2052ms and a cost of about $0.56.67% similarUnverifiedRunning vLLM 0.27.1 official image to infer Qwen2.5-0.5B-Instruct (fp16) on an H100 SXM 80GB on vast.ai ($2.689 per hour, 20 vCPU), the cost per million output tokens is about $1.26 under a single-request serial load.66% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1038480API
curl https://kongchang.com/api/v1/knowledge/claims/1038480MCP
get_claim(id=1038480)