Expired60% confidenceFactTime unknown
On the RTX 5090, the Qwen3.6 27B model with Q4 quantization has a decoding speed of approximately 63 tokens/s without MTP, jumping to 105 tokens/s with MTP enabled.
2
Sources
60%
Confidence
Medium-term (~90 days)
Relevance
6/1/2026
First Seen
Valid until: 8/30/2026(expired)
Sources
Related Entities
Related Claims
UnverifiedThe Qwen3.6 35B model achieved a generation speed of 86.7 tokens/s on oMLX with MTP technology, with a prompt processing speed of 1,735 tokens/s.85% similarUnverifiedWhen VRAM is sufficient and the model is fully resident on the GPU, an RTX 4090 running a Q4-quantized 27B model can typically achieve 15–30 tokens/s; once CPU offloading is triggered, the speed may drop sharply to 1–2 tokens/s or even lower.76% similarUnverifiedIn an RTX 5070 (12GB VRAM) configuration, the local Qwen3 9B model's output speed reached approximately 70–76 tokens/second.76% similarUnverifiedOn the RTX 5090, the Qwen3.6 27B model's prefill speed increases from 174 to 253 tokens/s, with a VRAM usage of approximately 18 GB.74% similarUnverifiedRunning the Qwen3.6 27B model on a GPU with 24 GB of VRAM, the generation speed reaches approximately 40 tokens per second without optimization, and 50–60 tokens/s after optimization.74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/18058API
curl https://kongchang.com/api/v1/knowledge/claims/18058MCP
get_claim(id=18058)