Expired80% confidenceFactTime unknown
Models such as GPT-4, Claude 3.5, and DeepSeek have achieved pass rates exceeding 80% on the HumanEval programming benchmark.
18
Sources
80%
Confidence
Medium-term (~90 days)
Relevance
5/31/2026
First Seen
Valid until: 8/29/2026(expired)
Sources
Related Entities
Related Claims
UnverifiedGPT-4 and Claude 3 achieve pass@1 rates exceeding 85% on the HumanEval code benchmark.83% similarUnverifiedIn standardized tests, GPT-4's performance has surpassed that of more than 90% of human test-takers.79% similarUnverifiedWhen a GPT-4-level model acts as a Judge, its evaluation results agree with human experts more than 80% of the time.77% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/5091API
curl https://kongchang.com/api/v1/knowledge/claims/5091MCP
get_claim(id=5091)