tau-bench
An AI agent evaluation benchmark proposed by Stanford University and collaborating institutions, designed to assess the reliability of tool-augmented agents in real-world database interaction scenarios. It measures whether system states match expected outcomes and evaluates success rates across repeated task executions.
Timeline (last 90 days)
The tau-bench benchmark focuses on whether an agent reaches the expected database state and requires consistent success across multiple repeated attempts.
tau-bench is an agent evaluation benchmark proposed by Stanford University and other institutions, targeting the reliability assessment of tool-assisted agents in real database interaction scenarios.
tau-bench uses whether the system state after agent execution matches expectations as its criterion, rather than the output content of a single conversation.
All Facts (3)
The tau-bench benchmark focuses on whether an agent reaches the expected database state and requires consistent success across multiple repeated attempts.
50%Unverifiedtau-bench is an agent evaluation benchmark proposed by Stanford University and other institutions, targeting the reliability assessment of tool-assisted agents in real database interaction scenarios.
50%Unverifiedtau-bench uses whether the system state after agent execution matches expectations as its criterion, rather than the output content of a single conversation.
50%