Verified65% confidenceFactExact time
128GB DDR5 memory can fully load all weights of a 70B-class model, but at a speed of approximately 2–5 tokens/s.
3
Sources
65%
Confidence
Medium-term (~90 days)
Relevance
8/7/2026
First Seen
Valid until: 11/5/2026
Sources
Related Claims
UnverifiedThe evaluation used a hardware configuration of 64GB DDR5 memory paired with 2 R9700 graphics cards.77% similarUnverifiedA 70B-parameter model (140 GB of weights) has a theoretical maximum generation speed of approximately 7 tokens/second at 1 TB/s bandwidth.77% similarUnverifiedUnder the M5 Ultra's 1.2 TB/s bandwidth, the theoretical speed of a 100 GB quantized model is approximately 12 tokens/s, a 200 GB model approximately 6 tokens/s, and a 300 GB model approximately 4 tokens/s.76% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/704254API
curl https://kongchang.com/api/v1/knowledge/claims/704254MCP
get_claim(id=704254)