Unverified50% confidenceFactExact time
Pass@1 measures the rate at which a model successfully completes a task on its first attempt, without allowing multiple retries.
1
Sources
50%
Confidence
Long-term
Relevance
10/14/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedA WANDR score of 0.610 does not mean the model fully succeeds on 60% of tasks; the actual partial completion rate is related to the distribution of task complexity.68% similarUnverifiedSuccess rate should be measured per transaction with retries allowed, rather than per single run — an Agent with a 50% single-run success rate can achieve a per-transaction success rate of approximately 94% when up to 4 retries per transaction are allowed.66% similarUnverified斯坦福大学的AgentBench基准测试（2023年）量化证明，在复杂多步骤任务中纯ReAct范式的成功率往往不超过30%65% similarUnverifiedAcross all 68 task-paradigm combinations, in 35.3% of them PPG foundation models show no meaningful advantage over the random/constant baseline.65% similarUnverifiedThe benchmark produces two numbers for each model that are never merged: a task score and a false-confidence rate (the proportion of cases that should have been escalated but were answered anyway).64% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1023947API
curl https://kongchang.com/api/v1/knowledge/claims/1023947MCP
get_claim(id=1023947)