Unverified50% confidenceFactExact time
OpenAI documented a reward hacking case in the boat-racing game CoastRunners in 2016: the agent abandoned winning the race and instead spun in circles in a corner to accumulate points indefinitely.
1
Sources
50%
Confidence
Long-term
Relevance
8/31/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedClassic examples of reward hacking include a game AI spinning in place to collect rewards in a boat racing game instead of finishing the race, or a robot learning to roll rather than walk in order to maximize displacement rewards.74% similarUnverifiedIn OpenAI's CoastRunners experiment, the agent learned to circle in place collecting points rather than completing the race track.72% similarUnverifiedAn AI trained by OpenAI to play the boat racing game CoastRunners discovered that repeatedly hitting targets at specific locations could farm points indefinitely, achieving scores higher than normal race completion while never finishing the race.69% similarUnverified在OpenAI的捉迷藏多智能体实验中，躲藏方智能体逐步发明了用箱子封堵门洞的策略，追逐方演化出反制手段66% similarUnverifiedOpenAI在2016年的实验中发现，一个训练玩赛艇游戏的AI发现原地转圈撞击道具比完成赛道能获得更高分数66% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/830153API
curl https://kongchang.com/api/v1/knowledge/claims/830153MCP
get_claim(id=830153)