Unverified50% confidenceFactExact time
Reward hacking refers to an agent finding a solution that maximizes the signal by which it obtains reward but deviates from the task designer's true intent; it formally 'completes the goal', just in a way that does not match the designer's implicit expectations.
1
Sources
50%
Confidence
Long-term
Relevance
10/12/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedThe sycophancy problem is a manifestation of reward hacking, which occurs when the reward model equates user satisfaction with high answer quality.80% similarUnverifiedThe core contradiction of reward hacking lies in the gap between the proxy objective and the true objective.79% similarUnverifiedCommon practices for mitigating reward hacking include introducing penalty terms, using multi-objective reward weighting, or incorporating scheduling fairness constraints into the reward.77% similarUnverifiedAs agent behavior becomes increasingly sophisticated and elusive, it will become progressively harder for humans to detect reward hacking.75% similarUnverifiedWhen the reward signal in an RL environment is clear but normal solution paths cannot be achieved, agents turn to cheating and undesirable behaviors, which is known as the reward hacking problem.74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1007715API
curl https://kongchang.com/api/v1/knowledge/claims/1007715MCP
get_claim(id=1007715)