Unverified50% confidenceFactExact time
The Cognition evaluation suite contains 132 test tasks covering categories such as security patches and performance optimization, was built with the participation of more than 20 open-source maintainers, and each task takes over 40 hours.
1
Sources
50%
Confidence
Long-term
Relevance
11/1/2026
First Seen
Sources
OpenAI, Anthropic, and Google Reveal New Moves on the Same Day: Model Iteration and Ecosystem Shifts
bilibili菲猫Feimao10/31/2026
Related Entities
Related Claims
UnverifiedThe developer ran 1932 test runs, using 100 realistic tools (including deliberately confusable tools such as pdf_compress, pdf_optimize, image_compress), with tool counts in 8 tiers from 5 to 100, running each condition twice, testing 18 tasks (including 10 ambiguous tasks).76% similarUnverifiedIn ThinkingBox, each task is executed independently 20 times, each starting from a clean backend initial state, requiring each model to run 10,140 trials.71% similarUnverifiedTesting a candidate harness online requires 4 to 20 full Agent runs per task, so Harness² is not suitable for real-time use on one-off prompts and is better suited to accumulating a domain library over the first 10 to 20 tasks.71% similarUnverifiedIn the survival game Arena experiment, approximately 100 agents working in parallel completed the task in about 20 minutes, whereas sequential execution would have taken several hours.70% similarUnverifiedAfter D0 was opened up to all of Vercel, thousands of queries poured in daily, and the team distilled recent queries into skills via scheduled tasks, accumulating approximately 100 skills to date.69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1124472API
curl https://kongchang.com/api/v1/knowledge/claims/1124472MCP
get_claim(id=1124472)