Unverified50% confidenceFactExact time
"Q4" is a nominal label describing the overall approximate compression target, not the literal precision of each individual weight
1
Sources
50%
Confidence
Long-term
Relevance
8/14/2026
First Seen
Sources
看懂GGUF量化：Q4_K_M与Q4_K_S的真正区别
Related Claims
VerifiedQ4量化将每个权重参数从16位压缩到4位，理论上可将模型体积缩小约75%68% similarUnverifiedIn speculative decoding scenarios, the Q3 quantized version is actually slower than the Q4 quantized version.67% similarVerifiedGGUF量化格式（如Q4_K_M）通过将权重精度从32位浮点压缩到4位整数，通常只带来约1-5%的性能损失67% similarUnverifiedIn the Q4_K_XL scheme, MoE layers use MXFP4 and the remaining layers are compressed to Q8_0, achieving 96% same on top-1% prediction consistency66% similarUnverifiedQ4_K_M has a perplexity approximately 0.1–0.3 lower than pure Q4.65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/745187API
curl https://kongchang.com/api/v1/knowledge/claims/745187MCP
get_claim(id=745187)