Unverified50% confidenceBenchmarkExact time
The measured performance of llama-3.1-8b-instruct on EcoHash is a TTFT of 205 ms (p95) and about 143 tokens/second for a single stream.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
10/14/2026
First Seen
Valid until: 10/28/2026
Sources
Related Entities
Related Claims
UnverifiedIn terms of prompt processing speed, the RTX 4090 achieves approximately 3,000 tokens/s and the M5 Max approximately 800 tokens/s, giving NVIDIA a clear advantage in long-document and codebase input scenarios.71% similarUnverifiedOn 6 RTX 5090 GPUs, Colibri's measured speed reaches 9.0–9.2 tokens/s, while on a 25GB development machine streaming from NVMe the speed is 0.05–0.1 tokens/s.71% similarUnverifiedOn an RTX 5090, Muse Glimmer runs at 75 tokens/second without speculative decoding, and reaches 233 tokens/second when paired with a speculative decoding model69% similarUnverifiedIn tests with the 4-bit quantized version (fitting entirely into 32 GB of VRAM), Ollama reached 240 tokens/s while FreeToken reached 225 tokens/s, making Ollama actually faster.69% similarUnverifiedThe RTX 4090 has a theoretical FP16 compute performance of 330 TFLOPS, and the actual Decode speed for a 7B FP16 model is typically 50–60 tokens/s.69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1025608API
curl https://kongchang.com/api/v1/knowledge/claims/1025608MCP
get_claim(id=1025608)