Unverified50% confidenceOpinionExact time
Most Agent evaluations focus only on task completion (such as whether a flight was booked, a ticket was closed, or the code runs), and almost no evaluation measures whether the Agent noticed warnings in the context before executing.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/15/2026
First Seen
Valid until: 1/13/2027
Sources
Related Entities
Related Claims
UnverifiedWhen Agent results deviate, the completeness of the context should be examined rather than rushing to adjust the prompt.73% similarUnverified干活的Agent绝不能给自己打分，评估器不应与执行任务的Agent共享同一上下文，否则会产生带偏见的评估结果70% similarUnverifiedTo prevent agent objective function gaming, the scoring script should not be placed inside the workspace during automated evaluation; the scorer should be hidden outside the sandbox, and testing should always be conducted with inputs the agent does not know.70% similarUnverifiedWhen testing agents, failure cases should be deliberately included; an agent that only passes on demo requests is not yet ready for real workflows70% similarUnverifiedAgents focused on a single task tend to produce more predictable and more easily reviewable results than all-purpose Agents, because their context windows are not polluted by irrelevant information70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1036212API
curl https://kongchang.com/api/v1/knowledge/claims/1036212MCP
get_claim(id=1036212)