Unverified70% confidenceFactExact time
GPT-4 as a judge can achieve over 80% agreement with human evaluations, but exhibits systematic issues such as position bias, verbosity bias, and self-preference.
2
Sources
70%
Confidence
Long-term
Relevance
9/11/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedIn an editing benchmark, the same GPT model's score dropped from 99% to 70% depending on the framework used.70% similarUnverifiedThe gpt-4o-mini judge mislabeled as high as 77.1% of human cases on the enriched set that should have been judged as faithful69% similarUnverifiedA joint study by BCG and Harvard found that when using GPT-4 for management consulting tasks, the human-AI collaboration group outperformed the human-only group by approximately 40%, provided that the boundaries of AI capabilities were accurately identified68% similarUnverifiedGPT-4等大模型在Spider等基准测试上的零样本或少样本SQL生成准确率已超过80%68% similarUnverifiedGPT-6 Astra achieved a near-perfect score of 99.9% on ARC-AGI-type tests, while the average score of ordinary human test-takers was only 48%.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/894786API
curl https://kongchang.com/api/v1/knowledge/claims/894786MCP
get_claim(id=894786)