Unverified50% confidenceFactExact time
A seemingly reasonable reward function may induce the agent to learn degenerate behaviors, for example repeatedly triggering a small reward in a game environment while giving up on completing the main task.
1
Sources
50%
Confidence
Long-term
Relevance
10/30/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedReward function design requires balancing the encouragement of forward racing against the penalization of collisions, and design bias may cause the agent to learn a degenerate strategy of remaining stationary78% similarUnverifiedWithout the potential function shaping constraint, artificially set shaping rewards easily induce the policy to pursue shaping bypasses rather than truly completing the task (reward hacking).77% similarUnverified当奖励函数未对控制代价加以惩罚时，梯度会持续将策略推向动作边界，产生 Bang-Bang 行为，这被称为奖励作弊（Reward Hacking）77% similarVerifiedReward shaping refers to adding extra, denser guiding reward signals on top of the original sparse reward to help agents learn faster and more correctly.77% similarUnverifiedProcess reward scores intermediate steps within the multi-step trajectories an agent executes, providing a denser signal that alleviates the credit assignment problem in long-horizon tasks; outcome reward is given only at the end of a task based on the final state, with a sparse signal but a clear objective.75% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1117330API
curl https://kongchang.com/api/v1/knowledge/claims/1117330MCP
get_claim(id=1117330)