[KongchangAI]
ConceptTrajectory Evaluation

Trajectory Evaluation

A common term in agent evaluation referring to the method of taking an agent's complete execution trajectory from receiving a task to producing a result, including tool calls, parameters and reasoning steps, as the object of evaluation.

Timeline (last 90 days)

Nov 9

Another community approach emphasizes trajectory evaluation, that is, not only caring about the result but also examining whether each decision step in the agent's execution process is reasonable.

Unverified50%
Nov 9

Trajectory evaluation means taking the agent's complete execution process from receiving a task to giving a result as the object of evaluation, rather than only comparing the final answer.

Unverified50%
Nov 9

Common practices in trajectory evaluation include comparing trajectories with reference trajectories, using rules to check key steps, or having a judge model score the trajectory.

Unverified50%
Sep 11

There are currently no mature standards for Agent evaluation, and Trajectory Evaluation is one of the mainstream research directions.

Unverified50%

All Facts (4)

Source Articles