Unverified50% confidenceBenchmarkExact time
Running the bonsai-8b model on a MacBook Pro (M4 Pro CPU, 12 cores, 24 GB memory), the generation speed is 21.0 tok/s, active power is 11.7 W, and energy per token is 0.886 J.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
10/15/2026
First Seen
Valid until: 10/29/2026
Sources
Related Entities
Related Claims
UnverifiedLing 3.0 Tiny achieves an inference speed of approximately 86–90 tokens per second on a MacBook with M4 Pro, with a peak memory usage of approximately 8.34 GiB under an 8K context.71% similarUnverified27B稠密模型在24GB M4 Pro Mac mini上使用4-bit量化可以运行，速度约为11 tok/s71% similarUnverifiedIn short-answer scenarios, on the same M4 Mac, merely changing the power mode jumps the speed from 28.5 tokens/s to 109.6 tokens/s, a difference of 3.84 times.69% similarUnverifiedOn an Apple Silicon MacBook Air (M4, 10-core CPU, 16 GB), Whisper large-v3-turbo has an average latency of 0.68 seconds, a real-time factor of 0.095, and a WER of 2.89% (29/1002).69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1039252API
curl https://kongchang.com/api/v1/knowledge/claims/1039252MCP
get_claim(id=1039252)