Unverified50% confidenceFactExact time
o4-mini and gpt-5-thinking-mini have almost the same accuracy on SimpleQA, but the latter makes roughly three times fewer errors than the former.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/18/2026
First Seen
Valid until: 1/16/2027
Sources
Related Entities
Related Claims
UnverifiedThe best-performing Edu-QuRater achieved an average accuracy of 0.917 in reproducing GPT-4.1-mini pairwise judgments on the held-out set.75% similarUnverifiedOn the SimpleQA benchmark, o4-mini declines to answer only 1% of questions, with an error rate of 75%.74% similarUnverifiedOn the SimpleQA benchmark, gpt-5-thinking-mini declines to answer 52% of questions, with an error rate of 26%.73% similarUnverifiedThe int4 build from Google's QAT checkpoint on Gemma 4 E2B is less than 0.5 points lower in accuracy than bf16 (0.678 vs 0.683), while the int8 build rounded directly from bf16 dropped 1.3 points.72% similarUnverifiedIn the task of completing the last Token of an FP8 quantization function, after DeepSeek-V4-Flash-Base adds equal-sign decorations before the code, when the number of equal signs modulo 4 is 0 or 1 the error rate is as high as 71.3%, and when the remainder is 2 or 3 the accuracy returns to 91.5%.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1063185API
curl https://kongchang.com/api/v1/knowledge/claims/1063185MCP
get_claim(id=1063185)