Unverified50% confidenceFactExact time
Frontier large models perform poorly at directly predicting alignment risks on ALIGNMENTFORECASTBENCH.
1
Sources
50%
Confidence
Long-term
Relevance
9/30/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedGeneral-purpose large language models exhibit inconsistency in security judgments, and the same risky operation may bypass their security mechanisms simply by being rephrased or provided with a justifying context79% similarUnverifiedThe low-probability, high-impact risk framework originates from expected utility theory and catastrophic risk research.76% similarUnverifiedInterpretability research into model internals and methods for assessing potential risks often lag behind capability growth.76% similarUnverifiedWhen a large model encounters a catastrophic failure (negative reward) during a long-horizon task, the policy network tends to favor behaviors with low expected returns but also low risk, which is referred to as excessive risk aversion or a locally optimal strategy76% similarVerifiedSome models carry the risk of over-optimization toward test sets, causing leaderboard scores to deviate from real-world performance (benchmark saturation).73% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/961166API
curl https://kongchang.com/api/v1/knowledge/claims/961166MCP
get_claim(id=961166)