Unverified50% confidenceBenchmarkExact time
Nimble 9B completes a decision in an average of 90 milliseconds on the M5 Max, with only 1 to 4 output tokens and between 155 and 841 input tokens.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/7/2026
First Seen
Valid until: 1/5/2027
Sources
Related Entities
Related Claims
UnverifiedIn benchmark testing on an AMD RX 7900 GPU, Ornith 35B achieved an overall accuracy of 85% (18 out of 21 passed), a generation speed of 74 tokens/s, a prompt processing speed of 850 tokens/s, and a VRAM usage of 20 GB.69% similarUnverifiedThe UP host tested MiniCPM-2B on a computer with 4G VRAM and achieved a generation speed of 57 tokens per second, with a first-token latency of only 0.22 seconds.69% similarUnverifiedGemma量化模型在高性能笔记本电脑上Token生成速度可达每秒20-50个，纯CPU推理约5-15 tokens/秒，INT4量化下NVIDIA RTX 4060/4070可将推理速度提升3-5倍68% similarUnverifiedThe M5 Max's token generation speed is approximately in the range of 10–30 tokens/s (depending on model size), while the NVIDIA H100's HBM3 memory bandwidth reaches up to 3.35 TB/s, enabling inference speeds tens of times faster than local devices.68% similarUnverifiedLing 3.0 Tiny achieves an inference speed of approximately 86–90 tokens per second on a MacBook with M4 Pro, with a peak memory usage of approximately 8.34 GiB under an 8K context.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/984288API
curl https://kongchang.com/api/v1/knowledge/claims/984288MCP
get_claim(id=984288)