Benchmarktask success rate
Task Success Rate
A core metric in agent evaluation that measures the proportion of ordinary tasks whose produced artifacts match a frozen oracle byte for byte. When used alone, it may conceal failures on refusal slices, so it must be read together with metrics such as abstention accuracy and invalid completion rate.
Timeline (last 90 days)
Sep 18
Task success must be a verifiable business end state (the database was actually written, the file was actually created on disk), not just the model claiming it has completed the task.
Unverified50%