Unverified50% confidenceBenchmarkExact time
在M1及以上芯片上，whisper.cpp运行base模型的实时因子（RTF）可达0.1以下，即处理速度是实时的10倍以上
1
Sources
50%
Confidence
Long-term
Relevance
8/6/2026
First Seen
Sources
Related Claims
Unverified将模型权重从FP16压缩到INT8或INT4的量化技术，可使消费级GPU如RTX 4090在本地部署时达到30-80 TPS的实用速度68% similarUnverifiedWhisper small模型约有244M参数，在消费级CPU上即可流畅运行67% similarUnverifiedDeepSeek V4 Flash has a rate limit of 10 requests per minute (10 RPM) and 100K tokens per minute (100K TPM) on the OpenModel platform.65% similarUnverifiedMemStitch claims to bring up to a 25× speedup in TTFT for vLLM through "zero-copy context bridging" technology.65% similarUnverifiedOn high-performance laptops, quantized Gemma models can achieve token generation speeds of 20–50 tokens per second; pure CPU inference is approximately 5–15 tokens/second, and INT4 quantization on NVIDIA RTX 4060/4070 can boost inference speed by 3–5 times.65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/692837API
curl https://kongchang.com/api/v1/knowledge/claims/692837MCP
get_claim(id=692837)