Unverified50% confidenceBenchmarkExact time
In the MMLU Pro test, 8-bit narrowly beat OQ4E with 60.6% versus 59.9%.
1
Sources
50%
Confidence
Long-term
Relevance
9/11/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedIn the MMLU test, OQ4E surpassed 8-bit with 84.5% versus 82.8%.78% similarUnverifiedIn actual tests of 8-bit and 4-bit (OQ4E) quantization of the same Qwen3 27B model based on the MLX framework, each won 5 out of 10 accuracy tests, resulting in a tie.66% similarUnverifiedOn the code generation task HumanEval, 8-bit scored 92.7%, significantly higher than OQ4E's 89.6%.63% similarUnverifiedOn the math reasoning task GSM8K, OQ4E answered 954 questions correctly (95.4%), while 8-bit only answered 924 correctly (92.4%), with the 4-bit version coming out 3 percentage points higher.63% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/907287API
curl https://kongchang.com/api/v1/knowledge/claims/907287MCP
get_claim(id=907287)