Trajectory Evaluation
A common term in agent evaluation referring to the method of taking an agent's complete execution trajectory from receiving a task to producing a result, including tool calls, parameters and reasoning steps, as the object of evaluation.
Timeline (last 90 days)
Another community approach emphasizes trajectory evaluation, that is, not only caring about the result but also examining whether each decision step in the agent's execution process is reasonable.
Trajectory evaluation means taking the agent's complete execution process from receiving a task to giving a result as the object of evaluation, rather than only comparing the final answer.
Common practices in trajectory evaluation include comparing trajectories with reference trajectories, using rules to check key steps, or having a judge model score the trajectory.
There are currently no mature standards for Agent evaluation, and Trajectory Evaluation is one of the mainstream research directions.
All Facts (4)
Another community approach emphasizes trajectory evaluation, that is, not only caring about the result but also examining whether each decision step in the agent's execution process is reasonable.
50%UnverifiedTrajectory evaluation means taking the agent's complete execution process from receiving a task to giving a result as the object of evaluation, rather than only comparing the final answer.
50%UnverifiedCommon practices in trajectory evaluation include comparing trajectories with reference trajectories, using rules to check key steps, or having a judge model score the trajectory.
50%UnverifiedThere are currently no mature standards for Agent evaluation, and Trajectory Evaluation is one of the mainstream research directions.
50%