τ²-Bench
A benchmark for evaluating the task-completion capabilities of tool-using LLM agents in real-world scenarios, including subsets such as telecommunications. It assesses agent accuracy and efficiency across multi-turn tool-calling interactions.
Timeline (last 90 days)
SkillScaffold was evaluated on four benchmarks—ALFWorld, WebShop, ScienceWorld, and τ²-Bench—and surpassed strong agentic RL baselines and skill-driven RL baselines on both short-horizon and long-horizon tasks.
The paper validates the effectiveness of CUE on the τ²-Bench multi-turn interaction evaluation benchmark.
Compared with other persona-based simulation methods, CUE-calibrated simulators produce fewer simulator-side errors (false failures).
CUE's experiments are conducted primarily on τ²-Bench with fitting data dominated by customer service interactions, and its calibration effectiveness in more specialized domains such as healthcare and law remains to be verified in subsequent work.
τ²-Bench is an evaluation benchmark designed specifically for multi-turn task-oriented dialogue, using final task success as the core metric and recording complete dialogue trajectories.
All Facts (5)
SkillScaffold was evaluated on four benchmarks—ALFWorld, WebShop, ScienceWorld, and τ²-Bench—and surpassed strong agentic RL baselines and skill-driven RL baselines on both short-horizon and long-horizon tasks.
50%UnverifiedThe paper validates the effectiveness of CUE on the τ²-Bench multi-turn interaction evaluation benchmark.
50%UnverifiedCompared with other persona-based simulation methods, CUE-calibrated simulators produce fewer simulator-side errors (false failures).
50%UnverifiedCUE's experiments are conducted primarily on τ²-Bench with fitting data dominated by customer service interactions, and its calibration effectiveness in more specialized domains such as healthcare and law remains to be verified in subsequent work.
50%Unverifiedτ²-Bench is an evaluation benchmark designed specifically for multi-turn task-oriented dialogue, using final task success as the core metric and recording complete dialogue trajectories.
50%