Unverified50% confidenceFactExact time
对齐税(Alignment Tax)指基于人类反馈的强化学习(RLHF)训练可能让模型倾向于给出看似完整的答案,而非坦诚承认不确定性
1
Sources
50%
Confidence
Long-term
Relevance
8/17/2026
First Seen
Sources
与AI协作编程:为什么越来越像在带团队而非写代码
Related Claims
UnverifiedThe RLHF (Reinforcement Learning from Human Feedback) training method optimizes for the model's overconfidence deficiency, training the model to proactively express uncertainty when uncertain.79% similarVerified确认偏误与RLHF(基于人类反馈的强化学习)训练方式相关,模型被优化为生成让人满意的回答79% similarVerifiedIn RLHF training, 'helpful and detailed answers' almost always receive higher scores, causing the model to learn to generate responses that appear complete and professional even when uncertain.78% similarUnverifiedSome systems embed safety preferences into model weights during the training phase through RLHF (Reinforcement Learning from Human Feedback), causing the model itself to tend to refuse generating certain content rather than relying on external filtering.77% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/762724API
curl https://kongchang.com/api/v1/knowledge/claims/762724MCP
get_claim(id=762724)