Unverified50% confidenceFactExact time
A successful response from most APIs only means the request was accepted (accepted), not that the task has ultimately been completed (completed).
1
Sources
50%
Confidence
Long-term
Relevance
10/12/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedIn automated systems, a process exiting normally (completion) is not equivalent to a task achieving its goal (outcome)—that is, completion is not an outcome.64% similarUnverifiedEvaluation methods that look only at the final answer (answer-only) count invalid execution processes as successes.61% similarUnverifiedWhen evaluating Agent capabilities, task completion rate is more indicative of a model's reliability than reasoning fluency.61% similarUnverifiedEven if all API calls succeed, an agent may produce no valuable output, so the entire run must be observed rather than just the success or failure of individual calls.60% similarUnverifiedTraditional task success rate metrics only focus on whether a task is completed, and cannot reflect the quality and efficiency of the execution process.60% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1004213API
curl https://kongchang.com/api/v1/knowledge/claims/1004213MCP
get_claim(id=1004213)