Unverified50% confidenceBenchmarkExact time
Two RTX 3080s combined can run Strata at up to 109 tokens per second; officially, a single 3090 is expected to reach 100 to 140 tokens per second.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
10/18/2026
First Seen
Valid until: 11/1/2026
Sources
Running a 125B-Parameter LLM on a 12GB GPU: Strata Local Deployment Hands-On
bilibili难言哟y10/17/2026
Related Entities
Related Claims
UnverifiedAn older RTX 3090, thanks to its 24 GB VRAM accommodating more experts, is estimated to achieve 100 to 140 tokens/second running Strata, indicating that under this workload VRAM capacity outweighs raw floating-point compute.80% similarUnverifiedThe Strata model generates 94 tokens per second on an RTX 5070 and 60 tokens per second on an AMD 9070 XT.72% similarUnverifiedOn an RTX 5070 with a 6-core Ryzen and 64 GB of memory, Strata achieves approximately 90 tokens/second for short conversations, approximately 67 tokens/second at a 128,000-token context, and approximately 1,300 tokens/second for reading prompts.72% similarUnverifiedIn terms of prompt processing speed, the RTX 4090 achieves approximately 3,000 tokens/s and the M5 Max approximately 800 tokens/s, giving NVIDIA a clear advantage in long-document and codebase input scenarios.72% similarVerifiedOn the RTX 5090, Muse Glimmer's generation speed increases from 75 tokens per second to 233 tokens per second, a speedup of approximately 3.1×.72% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1060177API
curl https://kongchang.com/api/v1/knowledge/claims/1060177MCP
get_claim(id=1060177)