Unverified50% confidenceFactExact time
RLHF本质上是优化模型表达风格使其符合人类偏好，而非赋予模型真实情感体验
1
Sources
50%
Confidence
Long-term
Relevance
7/9/2026
First Seen
Sources
Related Claims
UnverifiedThe core idea of RLMF is to optimize how accurately the model expresses its degree of confidence in an answer, rather than simply optimizing what the model says.80% similarUnverifiedRLHF is intended to align the model with human preferences, but human preferences tend to reward 'confident and detailed' responses, creating a paradox that reinforces hallucination76% similarUnverifiedRLHF本质上是在模型输出分布上施加统计偏好，而非植入真正的价值理解，导致表面对齐在面对对抗性输入时易崩塌75% similarUnverifiedRLHF评估员往往更偏好自然、友好、有温度的表达，使模型学会用第一人称叙事获得更高评分，拟人化是被奖励出来的涌现性语言行为74% similarVerifiedIn the RLHF mechanism, human annotators tend to give higher scores to responses that exceed expectations and provide additional details, thereby systematically encouraging the model to perform inferential completion74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/344158API
curl https://kongchang.com/api/v1/knowledge/claims/344158MCP
get_claim(id=344158)