[KongchangAI]
Unverified50% confidenceEventExact time

Between OSWorld 2.0 and 2.1, 174 pull requests targeting task files were merged.

1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/12/2026
First Seen
Valid until: 1/10/2027

Sources

Computer Use Benchmarks: Ten Pitfalls That Make a Single Correct Run Take 400 Hours

Related Entities

OSWorldproduct

Related Claims

UnverifiedCMU's Odyssey benchmark contains 200 tasks, each accompanied by multiple rubrics, supporting partial scoring rather than a single binary judgment.54% similar

Cite This Claim

Stable URI
https://kongchang.com/claim/1009491
API
curl https://kongchang.com/api/v1/knowledge/claims/1009491
MCP
get_claim(id=1009491)