Unverified50% confidenceFactExact time
Incentive distortion refers to when individual incentives and collective goals are misaligned, participants optimize the rewarded metrics rather than the genuinely valuable goals.
1
Sources
50%
Confidence
Long-term
Relevance
10/17/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe greatest risk of self-improvement comes from the reward signal itself: if the reward is improperly defined, the agent will optimize evaluation metrics rather than the true objective (the reinforcement learning version of Goodhart's Law).76% similarUnverifiedIntention-based tools tend to overestimate real demand due to factors including the social desirability effect, present-moment emotional bias, and contextual distortion76% similarUnverifiedWhen extrinsic incentives are overly prominent, a crowding-out effect occurs, undermining an individual's intrinsic motivation.74% similarUnverifiedIn reinforcement learning, the reward signal is a proxy for the designer's intent, not the intent itself.72% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1055362API
curl https://kongchang.com/api/v1/knowledge/claims/1055362MCP
get_claim(id=1055362)