Unverified50% confidenceBenchmarkExact time
When the model needs to be offloaded to the CPU, the text generation speed drops sharply from 75 t/s to 5–20 t/s.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
9/7/2026
First Seen
Valid until: 12/6/2026
Sources
Related Entities
Related Claims
Cite This Claim
Stable URI
https://kongchang.com/claim/871778API
curl https://kongchang.com/api/v1/knowledge/claims/871778MCP
get_claim(id=871778)