Existential Risk
Existential risk refers to a category of risk that could lead to the permanent destruction of human civilization or casualties at an extreme scale. In the AI domain, it specifically denotes the catastrophic consequences that could result from the loss of control over highly capable AI systems, and it is one of the central topics in AI safety research.
Core Facts
Existential risk refers to risks that could cause permanent regression or even extinction of human civilization; frontier AI is regarded as an emerging source of existential risk, whose particularity lies in its diffuse threat mechanisms, difficulty of intuitive perception, and the possibility that the governance window may close rapidly as capabilities grow.
The tradition of existential risk research was systematically articulated in the early 21st century by philosophers such as Nick Bostrom.
The long-term impact of AI technology is highly uncertain; promises to benefit billions of people are often unverifiable, while potential catastrophic risks may be irreversible.
Timeline (last 90 days)
The concept of existential risk was systematically proposed by Oxford University philosopher Nick Bostrom in his 2002 paper "Existential Risks."
Existential risk refers to risks that could cause permanent regression or even extinction of human civilization; frontier AI is regarded as an emerging source of existential risk, whose particularity lies in its diffuse threat mechanisms, difficulty of intuitive perception, and the possibility that the governance window may close rapidly as capabilities grow.
Proponents of existential risk use an expected value framework, arguing that although the probability of risk is low, the consequences are infinitely severe and therefore warrant priority attention
The long-term impact of AI technology is highly uncertain; promises to benefit billions of people are often unverifiable, while potential catastrophic risks may be irreversible.
The tradition of existential risk research was systematically articulated in the early 21st century by philosophers such as Nick Bostrom.
All Facts (5)
Existential risk refers to risks that could cause permanent regression or even extinction of human civilization; frontier AI is regarded as an emerging source of existential risk, whose particularity lies in its diffuse threat mechanisms, difficulty of intuitive perception, and the possibility that the governance window may close rapidly as capabilities grow.
65%VerifiedThe tradition of existential risk research was systematically articulated in the early 21st century by philosophers such as Nick Bostrom.
65%Partially VerifiedThe long-term impact of AI technology is highly uncertain; promises to benefit billions of people are often unverifiable, while potential catastrophic risks may be irreversible.
65%UnverifiedThe concept of existential risk was systematically proposed by Oxford University philosopher Nick Bostrom in his 2002 paper "Existential Risks."
50%UnverifiedProponents of existential risk use an expected value framework, arguing that although the probability of risk is low, the consequences are infinitely severe and therefore warrant priority attention
50%