Unverified50% confidenceBenchmarkExact time
The current dataset contains 770 recorded attempts across 29 model/configuration entries, but the unified test suite includes only 16 distinct tasks.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/12/2026
First Seen
Valid until: 1/10/2027
Sources
Related Entities
Related Claims
UnverifiedThis benchmark uses 10 original short documents of 200 to 250 words each, with 18 planted anomalies, 37 scoring entries in total (18 dirty and 19 clean), testing 13 models with 74 prompts per model.75% similarUnverifiedThe test suite consists of 10 benchmarks; most run 1,000 questions each, with HumanEval comprising 164 questions and TruthfulQA comprising 817 questions.71% similarUnverifiedIn a test that used Traework to fully simulate a product development workflow, the tool retrieved more than 100 sources during the research phase, but after manual verification only about 40 were truly usable, while the other 60 needed to be discarded or re-investigated.70% similarUnverified该测试样本规模相对有限（5个模型、13个代码库），结论有待更大规模验证69% similarUnverified数据集中每个工具约有130种表达变体，并加入40个不使用工具的负样本68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1003722API
curl https://kongchang.com/api/v1/knowledge/claims/1003722MCP
get_claim(id=1003722)