Unverified50% confidenceBenchmarkExact time
On an RTX 5090, Muse Glimmer runs at 75 tokens/second without speculative decoding, and reaches 233 tokens/second when paired with a speculative decoding model
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/9/2026
First Seen
Valid until: 1/7/2027
Sources
Related Entities
Related Claims
VerifiedOn the RTX 5090, Muse Glimmer's generation speed increases from 75 tokens per second to 233 tokens per second, a speedup of approximately 3.1×.80% similarUnverifiedIn terms of prompt processing speed, the RTX 4090 achieves approximately 3,000 tokens/s and the M5 Max approximately 800 tokens/s, giving NVIDIA a clear advantage in long-document and codebase input scenarios.75% similarUnverifiedThe RTX 4090 has a theoretical FP16 compute performance of 330 TFLOPS, and the actual Decode speed for a 7B FP16 model is typically 50–60 tokens/s.74% similarUnverifiedWhen VRAM is sufficient and the model is fully resident on the GPU, an RTX 4090 running a Q4-quantized 27B model can typically achieve 15–30 tokens/s; once CPU offloading is triggered, the speed may drop sharply to 1–2 tokens/s or even lower.73% similarUnverifiedOn 6 RTX 5090 GPUs, Colibri's measured speed reaches 9.0–9.2 tokens/s, while on a 25GB development machine streaming from NVMe the speed is 0.05–0.1 tokens/s.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/993076API
curl https://kongchang.com/api/v1/knowledge/claims/993076MCP
get_claim(id=993076)