Unverified50% confidenceSolutionExact time
Success rate should be measured per transaction with retries allowed, rather than per single run — an Agent with a 50% single-run success rate can achieve a per-transaction success rate of approximately 94% when up to 4 retries per transaction are allowed.
1
Sources
50%
Confidence
Long-term
Relevance
10/7/2026
First Seen
Sources
Related Entities
Related Claims
Unverified对同一测试用例执行多次调用统计成功比例得到通过率，比二元的通过/失败判断更能反映模型真实表现73% similarUnverifiedIf a browser Agent has an independent per-step success rate of 99%, the overall success rate of a trajectory spanning 100 steps is approximately 36%.72% similarUnverified在歧义点的四类行为中，'先搜再问'成功率最高，平均通过率达93.4%，远高于'直接猜'的56.5%，'搜多次再猜'为51.5%72% similarUnverifiedA business process requiring 20 steps each with an 85% success rate has an overall success rate of approximately 4% (0.85 to the power of 20).72% similarUnverifiedA single performance percentage is misleading; a model that claims to retain 98% of performance may happen to fall within the lost 2% for a specific task type, and real tasks should be tested before trusting benchmarks.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/985239API
curl https://kongchang.com/api/v1/knowledge/claims/985239MCP
get_claim(id=985239)