Existential Risk

The 'doomerism' Feldman criticizes is the public expression of the 'existential risk' branch of alignment research, which holds that once a misaligned superintelligence emerges, the consequences may be irreversible.

The concept of existential risk (x-risk for short) was systematically proposed by Oxford University philosopher Nick Bostrom in 2002, referring to 'a threat that could permanently destroy the intelligent life originating on Earth.'

The LWiAI host tends to believe that at the current stage, the more urgent issue is the near-term risks of AI, rather than distant extinction scenarios.

Existential risk refers to risks that could cause permanent regression or even extinction of human civilization; frontier AI is regarded as an emerging source of existential risk, whose particularity lies in its diffuse threat mechanisms, difficulty of intuitive perception, and the possibility that the governance window may close rapidly as capabilities grow.

Existential Risk (X-Risk) refers to an event that could permanently and irreversibly end human civilization or drastically curtail its long-term potential.

The debate over whether AI constitutes an existential risk is highly abstract and difficult to substantiate, making it easy to fall into endless philosophical arguments.

The report candidly notes that AI security is an arms race with no end point, and the pragmatic approach is to continuously raise the cost of misuse, shorten the time from detection to response, and share threat intelligence across the industry

The tradition of existential risk research was systematically articulated in the early 21st century by philosophers such as Nick Bostrom.

In 2003, philosopher Nick Bostrom discussed the existential risks that superintelligence might pose in a paper.

The existential-risk narrative, in which some AI lab executives publicly warn that AI may pose extinction-level risks to humanity, may divert attention from the actual harms AI causes today.