Unverified50% confidenceBenchmarkExact time
The strongest configuration, GPT-5.5 paired with Codex, achieved a pass rate of only 28.0% on Harbor-Index
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
9/11/2026
First Seen
Valid until: 12/10/2026
Sources
Related Entities
Related Claims
UnverifiedThe original Codex achieved a pass@1 score of 28.8% on the HumanEval benchmark, whereas using GPT-3 directly yielded only 0%.74% similarUnverifiedCodex于2021年发布时在HumanEval基准上达到28.8%的pass@1得分,而GPT-4在同一基准上已超过67%71% similarUnverifiedThe median output token count per problem-solving attempt for Opus 4.7 is 60,000, while GPT 5.5 requires only 16,000.70% similarUnverifiedIn SWE-bench testing, the early GPT-4 resolution rate was below 2%, while Claude 3.5 Sonnet broke through 49%.66% similarUnverified在SWE-bench最初公开结果中GPT-4的解决率仅约1.7%,Devin宣称达到13.86%,SWE-agent达到12.5%66% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/902670API
curl https://kongchang.com/api/v1/knowledge/claims/902670MCP
get_claim(id=902670)