Unverified50% confidenceBenchmarkExact time
An agent based on a certain frontier language model, under a limit of at most one hour per record, had 82 submissions accepted and improved all records, but the improvements did not go beyond the scope of published literature.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/12/2026
First Seen
Valid until: 1/10/2027
Sources
Related Entities
Related Claims
UnverifiedAgents based on two newer models continued from these records, with 60 more submissions accepted, further improving 19 out of 20 records.68% similarUnverifiedIn a test-paper grading case, Cowork generated an analysis and HTML report containing an average score of approximately 72%, a minimum of 30 points, and a maximum of 100 points through a single instruction.64% similarUnverifiedHuman test subjects achieve an average accuracy of over 85% on ARC problems, while mainstream large language models have long hovered below 20%.63% similarUnverifiedAn evaluation suite with 1,800 test cases has long maintained a stable aggregate pass rate of 97%, but the 64-case multilingual slice within it has a pass rate of only 61%63% similarUnverifiedThe author recommends an "82 allocation" strategy: 80% of organizing and drafting is handled by faster, lower-cost models, while the most difficult 20% of complex execution and cross-tool delivery is handled by Astra.63% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1001186API
curl https://kongchang.com/api/v1/knowledge/claims/1001186MCP
get_claim(id=1001186)