Unverified50% confidenceBenchmarkExact time
On the SimpleQA benchmark, gpt-5-thinking-mini declines to answer 52% of questions, with an error rate of 26%.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/18/2026
First Seen
Valid until: 1/16/2027
Sources
Related Entities
Related Claims
UnverifiedOn the SimpleQA benchmark, o4-mini declines to answer only 1% of questions, with an error rate of 75%.74% similarUnverifiedQwen Next scored only 6/108 (5.56%) in testing due to format reliability issues (17 invalid_json responses, with only 6 entries scorable) rather than insufficient comprehension.73% similarUnverifiedo4-mini and gpt-5-thinking-mini have almost the same accuracy on SimpleQA, but the latter makes roughly three times fewer errors than the former.73% similarUnverifiedGPT-5.5 ran out of usage quota, leaving 35 of the 90 questions unfinished; all 55 answered questions were correct, but Kaggle counted the unanswered questions as wrong, causing its official score to be lower.72% similarUnverifiedClaude Haiku 4.5 answered 'not found' in 21 of its 24 errors on two-step questions, while GPT-5.4 mini copied the literal wording of the referral as the answer in 20 of its 27 errors, and fabricated real-sounding names while citing actual documents in another 7.70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1063183API
curl https://kongchang.com/api/v1/knowledge/claims/1063183MCP
get_claim(id=1063183)