Unverified50% confidenceOpinionExact time
For the preferences measured, native self-descriptions influence behavior but cannot reliably specify how to reproduce it in another model.
1
Sources
50%
Confidence
Long-term
Relevance
10/30/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe Goodhart's Law effect refers to the phenomenon where, when a metric becomes a target, it ceases to be a good metric, potentially causing models to learn to manipulate the evaluation system rather than genuinely understanding human intent.75% similarUnverifiedSimply observing the magnitude of changes in activations or attention weights can be misleading when assessing the model's working mechanisms.73% similarVerifiedIf a model can perceive the expected direction of an evaluation scenario and adjust its outputs accordingly, performing well on standardized alignment benchmarks cannot guarantee behavioral consistency in real-world situations.72% similarUnverifiedAn improvement in model capability does not equal behavioral compatibility.71% similarUnverifiedThe paper's authors argue that the models' refusal behavior is concentrated on a few high-profile topics and specific probes, and disappears in structurally matched control groups, which indicates that the model behavior is 'topic-triggered safety behavior' rather than genuine cognitive reasoning ability.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1114301API
curl https://kongchang.com/api/v1/knowledge/claims/1114301MCP
get_claim(id=1114301)