Unverified50% confidenceOpinionExact time
The precautionary principle holds that even if the probability of an extinction-level risk is not high, its consequences warrant the investment of enormous resources to prevent it.
1
Sources
50%
Confidence
Long-term
Relevance
9/12/2026
First Seen
Sources
Related Entities
Related Claims
Unverified安全对齐本质是在模型概率分布上施加偏置，而非从根本上消除有害能力71% similarUnverified回形针最大化器是博斯特罗姆的思想实验，揭示危险不一定来自恶意目标，一个错误指定的目标加上足够强大的优化能力后果可能同样灾难性65% similarUnverifiedA model reaching the Critical level means it possesses the potential, in specific capability dimensions, to cause serious and large-scale harm.63% similarUnverifiedBreaking down vague concerns about AI loss of control into specific risk categories enables more targeted preventive measures.63% similarUnverifiedThe more capable the model, the greater the challenges of alignment, safety, and governance, with risks growing exponentially.63% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/911074API
curl https://kongchang.com/api/v1/knowledge/claims/911074MCP
get_claim(id=911074)