Unverified50% confidenceBenchmarkExact time
On M4 Max, the text route using Omni 3B + TTS 1.7B (4.61 GB) has a median full-turn latency of 4.27 seconds, with a peak process RSS of 3.86 GiB.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
10/14/2026
First Seen
Valid until: 10/28/2026
Sources
Related Entities
Related Claims
Unverified单卡RTX 4090跑4Bit量化的通义千问3-27B约每秒生成49个字69% similarUnverifiedOn GSM8K, OQ4E took 2,450.2 seconds, while 8-bit took as long as 5,471.2 seconds, more than twice the time.69% similarUnverifiedOn the RTX 4070 SUPER, OpenDLSS NR takes 7.8 milliseconds per frame at 1080P, 12.6 milliseconds at 2K, and 29.3 milliseconds at 4K.69% similarUnverifiedLing 3.0 Tiny achieves an inference speed of approximately 86–90 tokens per second on a MacBook with M4 Pro, with a peak memory usage of approximately 8.34 GiB under an 8K context.68% similarUnverifiedThe decode write speed improvement from M4 Max to M5 Max is only 25%, constrained by memory bandwidth.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1023259API
curl https://kongchang.com/api/v1/knowledge/claims/1023259MCP
get_claim(id=1023259)