Unverified50% confidenceBenchmarkExact time
On Linux x86_64 (WSL2/Ubuntu, AVX2), BitRun has a first-token latency of about 130 ms and a generation speed of 40-45 t/s.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
10/13/2026
First Seen
Valid until: 10/27/2026
Sources
Related Entities
Related Claims
UnverifiedOn Windows 10/11 x86_64 (Intel Core i5-12600K, AVX2), BitRun runs Falcon3 1B at a generation speed of 40-45 t/s.78% similarUnverifiedA UP host running MiniCPM 2B with an RTX 4080S (16GB VRAM) + 64GB RAM configuration achieved an inference speed of approximately 110 tokens/second in real-world testing71% similarUnverifiedThe RTX 4090 has a theoretical FP16 compute performance of 330 TFLOPS, and the actual Decode speed for a 7B FP16 model is typically 50–60 tokens/s.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1018714API
curl https://kongchang.com/api/v1/knowledge/claims/1018714MCP
get_claim(id=1018714)