Unverified50% confidenceOpinionExact time
Reward hacking is one of the most classic and intractable failure modes in alignment research.
1
Sources
50%
Confidence
Long-term
Relevance
10/11/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe more precise and complex a reward function is, the harder it is to optimize; the simpler and more optimizable it is, the easier it is to exploit—this dilemma makes it extremely difficult to fundamentally eliminate reward hacking.70% similarUnverifiedOverly sparse rewards lead to extremely low learning efficiency, while poorly designed rewards can trigger the reward hacking problem.69% similarUnverifiedThe various approaches to mitigating reward hacking may themselves introduce new reward hacking pathways, creating an arms-race-style iterative dilemma.69% similarUnverifiedThe study categorized failures into two types: genuine capability deficits and issues that can be mitigated by adjusting the decoding threshold, further subdividing them into 4 failure mechanisms.69% similarUnverifiedThere is a natural tension between the depth of mathematical research and the short cycles of hackathons, as major mathematical breakthroughs are difficult to achieve within dozens of hours.66% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/998370API
curl https://kongchang.com/api/v1/knowledge/claims/998370MCP
get_claim(id=998370)