Verified65% confidenceBenchmarkExact time
In benchmark testing, Qwen3 27B achieved a generation speed of approximately 40-something tokens per second on 4 modified 2080 Ti cards without NVLink enabled.
3
Sources
65%
Confidence
Medium-term (~90 days)
Relevance
8/19/2026
First Seen
Valid until: 11/17/2026
Sources
魔改2080Ti本地部署Qwen3 27B实测：FP8量化低成本方案
Related Claims
UnverifiedThe typical generation speed of an NVIDIA RTX 4090 running a similarly scaled Q4 quantized model is in the range of 40–60 TPS80% similarUnverifiedOn an RTX 3060, the developer's hand-written Triton fused W4A16 GEMV kernel targeting batch-1 decoding runs at about 25.5 tok/s, matching the roughly 25.7 tok/s of the bitsandbytes NF4 quantization scheme.79% similarUnverifiedQwen3 27B's local inference speed is approximately 10 tokens per second.77% similarUnverifiedUnoptimized baseline token decoding speeds for running Qwen 3 (27B): RTX 5090 ~75, RTX 4090 ~46, RTX 3090 ~40, M5 Max 31.4, DGX Spark 12–17, Ryzen AI Max 11.5 tokens/s.76% similarUnverifiedThe Q4_K_M/GGUF version of Qwen 27B decodes at approximately 10.7 tok/s on the same machine, roughly 1/3.8 of the MLX version.74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/775271API
curl https://kongchang.com/api/v1/knowledge/claims/775271MCP
get_claim(id=775271)