Unverified50% confidenceDecision RuleExact time
The relationship between retrieval metrics (such as recall@k) and the agent's final task success rate is not linear; it is recommended to use the agent's success rate in completing business tasks as the north-star metric.
1
Sources
50%
Confidence
Long-term
Relevance
10/2/2026
First Seen
Sources
Related Claims
UnverifiedThe more specific the task and the clearer the feedback signal, the higher the agent's success rate; open-ended tasks with vague descriptions often cause agents to fall into repeated trial and error.67% similarUnverifiedTraditional task success rate metrics only focus on whether a task is completed, and cannot reflect the quality and efficiency of the execution process.67% similarUnverifiedTraditional evaluation metrics centered on task completion may fail to capture strategic behavior by agents at the collective level.66% similarUnverified推理速度与计算效率是长程Agent能否落地的关键指标，重要性不亚于单次回答的智能水平65% similarUnverifiedAgentic benchmarks use end-to-end task completion rate rather than single-step accuracy as the core metric.65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/968084API
curl https://kongchang.com/api/v1/knowledge/claims/968084MCP
get_claim(id=968084)