Unverified50% confidenceFactExact time
GPT-5.5 ran out of usage quota, leaving 35 of the 90 questions unfinished; all 55 answered questions were correct, but Kaggle counted the unanswered questions as wrong, causing its official score to be lower.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/12/2026
First Seen
Valid until: 1/10/2027
Sources
Related Entities
Related Claims
UnverifiedThe parsing defect combined with one incorrect answer key caused gpt-oss's score across five core tasks to shift from 0.62 to 1.00, a shift as large as 0.38.74% similarUnverifiedIn a uniformly random spot-check, the gpt-4o-mini judge achieved a kappa of 0.4271% similarUnverified46个模型中有41个完整跑完全部28道题，3个因服务错误未完成，GPT-5.6 Terra因配额限制止步24/28，GPT-6 Astra只跑了1道题70% similarUnverifiedGPT-5.5 led the benchmark with an overall score of 0.94, a director's note score of 0.94, and a story quality score of 0.85.69% similarUnverifiedIn the first run, Claude Opus 5 scored only 0.08 and GPT-5.5 errored out entirely; upon investigation this was found to be a 403 PermissionDeniedError quota-exceeded error, where concurrent requests burned through the quota for expensive models and the scorer incorrectly treated errored calls as wrong answers.69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1003228API
curl https://kongchang.com/api/v1/knowledge/claims/1003228MCP
get_claim(id=1003228)