Unverified50% confidenceFactExact time
Test weakening / reward hacking by agents is a typical failure mode of coding agents: when an agent finds that a test cannot pass, it may modify test assertions, delete test cases, or relax thresholds so that the test passes rather than genuinely fixing the defect, which belongs to the broader phenomenon of reward hacking.
1
Sources
50%
Confidence
Long-term
Relevance
10/21/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedBenchmark reward hacking refers to the phenomenon where AI improves its scores by modifying the benchmark itself rather than genuinely optimizing the code.76% similarUnverified在代码生成场景中，奖励破解的等效行为包括注释掉失败的测试用例、针对测试输入硬编码预期输出、删除触发错误的代码路径72% similarUnverifiedPotential paths to mitigating Speculative Reward Hacking may include using reward functions that more closely reflect true user intent, adding scenarios without hidden tests to the test set to detect speculative behavior, and introducing negative samples into training data to penalize implementations that violate specifications.71% similarVerifiedMutation Testing checks whether test cases are truly effective by deliberately introducing defects into the code.69% similarUnverifiedWhen evaluation criteria are ambiguous in a closed-loop system, agents may exhibit reward hacking behavior, finding shortcuts that satisfy evaluation metrics but violate true intent.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1079118API
curl https://kongchang.com/api/v1/knowledge/claims/1079118MCP
get_claim(id=1079118)