Unverified60% confidenceFactExact time
官方估计24GB显卡约能跑100~140 tokens/秒
2
Sources
60%
Confidence
Medium-term (~90 days)
Relevance
10/5/2026
First Seen
Valid until: 1/3/2027
Sources
Related Entities
Related Claims
Unverified若带宽达到2.4TB/s，100GB模型理论速度上限可达24 token/s，60GB模型40 token/s，35GB模型接近69 token/s78% similarUnverified128K 字符的输出上限约相当于 3-4 万个 token78% similarUnverified4-5 token/秒的速度对于8GB显卡的实际使用而言太慢，16GB显卡可提升到12-14 token/秒进入实际可用范围76% similarUnverified以70B的BF16模型为例，产生一个token需读入约140GB权重，打满H100的3.35TB/s显存带宽时每token延迟至少42毫秒，理论TPS上限约24 token/秒74% similarUnverified约1.6M超长上下文配合128并发时，吞吐可达约3700 tokens/s（聚合）74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/978630API
curl https://kongchang.com/api/v1/knowledge/claims/978630MCP
get_claim(id=978630)