Unverified50% confidenceBenchmarkExact time
On FDE-Gym, the best configuration achieved an average score of only 0.56, solving only 14 of the 95 tasks.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/19/2026
First Seen
Valid until: 1/17/2027
Sources
Related Entities
Related Claims
UnverifiedOn the 23 FDE-Gym tasks where all key facts had been obtained, the best configuration achieved meaningful business improvement on only 10 tasks.71% similarUnverifiedGoal gX has 187 recorded rows, a 100% pass rate, only one different task, and the why field of all records is 'exit=0 OK'; from October 4, 2026 to now, 187 runs have never failed, accounting for 10.1% of the entire ledger.65% similarUnverifiedThe parsing defect combined with one incorrect answer key caused gpt-oss's score across five core tasks to shift from 0.62 to 1.00, a shift as large as 0.38.64% similarUnverifiedThe target value for the Erdős minimum overlap problem is 0.38080, where lower is better; the value reported by TTT-Discover is 0.38093, and this run's result of 0.38094 is almost identical to the reported value but still has a tiny gap from the target.63% similarUnverifiedIn CAD World's 200-task evaluation, the best-performing GPT-5.4 achieved a success rate of only 17.5%.62% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1066084API
curl https://kongchang.com/api/v1/knowledge/claims/1066084MCP
get_claim(id=1066084)