Unverified50% confidenceBenchmarkExact time
In a comparison of Qwen3-0.6B in BF16 versus Q4_K_M, Q4_K_M changed the top-1 token at 11.6% of positions, with an average KL divergence of 0.067 and perplexity rising from 7.83 to 8.53.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/17/2026
First Seen
Valid until: 1/15/2027
Sources
Related Entities
Related Claims
UnverifiedAcross 12 blocks and 1282 scored positions, when Q4_K_M recovers BF16, attention eliminates 0.030 (95% CI 0.019–0.041) and MLP eliminates 0.036 (0.024–0.048), with the paired difference crossing zero so the two are indistinguishable; when injecting Q4_K_M into BF16, MLP adds more (0.014, 0.005 to 0.023).78% similarUnverifiedAt the is_prime token, after writing BF16's residual into Q4_K_M, that token's KL dropped from 0.48 after layer 6 to 0.04 after layer 9; the reverse write reproduced the flip from about layer 12, indicating the decisive difference forms between layers 6 and 12.77% similarVerifiedQ4_K_M has a perplexity approximately 0.1–0.3 lower than pure Q4.74% similarUnverifiedIn GGUF, BF16 uses 16 bits per parameter, Q8_0 approximately 8 bits, Q4_K_M approximately 4 bits, Q3_K_M approximately 3 bits, and Q2_K approximately 2 bits.73% similarUnverifiedThe average KL divergence of the UD-Q4_K_XL quantization published by Unsloth is 0.046893, with a top-1 agreement rate of 92.255% with BF16.72% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1054497API
curl https://kongchang.com/api/v1/knowledge/claims/1054497MCP
get_claim(id=1054497)