Unverified50% confidenceBenchmarkExact time
According to JudgeBench research, when GPT-4o scores, on questions it itself answers correctly, its agreement with experts reaches 0.78 (Cohen's κ); on questions it answers incorrectly, agreement drops sharply to 0.30.
1
Sources
50%
Confidence
Long-term
Relevance
10/14/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedGPT-5.5 ran out of usage quota, leaving 35 of the 90 questions unfinished; all 55 answered questions were correct, but Kaggle counted the unanswered questions as wrong, causing its official score to be lower.76% similarUnverifiedOn the disagreement-enriched dataset, the Cohen's kappa agreement coefficient between the gpt-4o-mini judge and the gold standard jointly confirmed by two authors was only 0.0475% similarUnverifiedThe study found that GPT-4's accuracy on the prime number identification task plummeted from 97.6% in March 2023 to 2.4% in June 2023.74% similarUnverifiedThe parsing defect combined with one incorrect answer key caused gpt-oss's score across five core tasks to shift from 0.62 to 1.00, a shift as large as 0.38.74% similarUnverifiedGPT-4在律师资格考试（BAR exam）中得分位于前10%，在SAT数学中接近满分71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1026025API
curl https://kongchang.com/api/v1/knowledge/claims/1026025MCP
get_claim(id=1026025)