Unverified50% confidenceDecision RuleExact time
When designing security protocols, overestimating risks is far better than underestimating them.
1
Sources
50%
Confidence
Long-term
Relevance
10/4/2026
First Seen
Sources
Related Entities
Related Claims
Unverified安全研究者将系统行动能力远超其安全判断能力的潜在风险称为能力越界（Capability Overhang）76% similarUnverifiedClassifiers in safety guardrails are probabilistic models with a tradeoff between false positives and false negatives; setting the threshold too low leads to excessive blocking.73% similarUnverified过度对齐（Over-alignment）指模型安全护栏设置过于敏感，在完全合法的使用场景中也拒绝提供帮助的反向风险71% similarVerifiedOver-refusal strategies reduce risk but harm model utility, especially in scenarios such as professional development and security research that require touching sensitive boundaries.70% similarUnverifiedWhen a large model encounters a catastrophic failure (negative reward) during a long-horizon task, the policy network tends to favor behaviors with low expected returns but also low risk, which is referred to as excessive risk aversion or a locally optimal strategy70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/973229API
curl https://kongchang.com/api/v1/knowledge/claims/973229MCP
get_claim(id=973229)