Gradual Disempowerment
An existential threat framework in the field of AI safety holding that even if individual AI systems remain controllable, human society may gradually lose its autonomy through widespread dependence on AI, ultimately leading to existential catastrophe.
Timeline (last 90 days)
Kulveit et al. proposed the theoretical framework of "Gradual Disempowerment," arguing that even if AI systems remain controllable at the individual level, human society may still gradually lose its autonomy because of widespread dependence on AI, ultimately leading to existential catastrophe.
The theory of gradual disempowerment holds that the core driving force behind the loss of human influence is that machines have become more competitive alternatives to humans in almost all social functions, covering economic labor, decision-making, artistic creation, and even emotional companionship.
Bentham's Bulldog and John Halstead raised criticisms of the theory of gradual disempowerment, including questioning whether disempowerment itself constitutes harm, whether a fully automated economy would really detach from humans, and whether competitive pressure would really intensify.
The author of this article admits that the gradual disempowerment argument is indeed anthropocentric, and that similar arguments could also be applied to animal welfare as well as to existing AI systems (if they can be regarded as moral patients).
The author of this article admits that the original text sometimes exaggerated its novelty, because the risk of AI-driven totalitarianism had been discussed for many years before the publication of "Gradual Disempowerment."
The author of this article argues that the contribution of the theory of gradual disempowerment lies in revealing the hiddenness and danger of the path by which humans gradually cede control in the process of pursuing efficiency and competitiveness.
All Facts (6)
Kulveit et al. proposed the theoretical framework of "Gradual Disempowerment," arguing that even if AI systems remain controllable at the individual level, human society may still gradually lose its autonomy because of widespread dependence on AI, ultimately leading to existential catastrophe.
50%UnverifiedThe theory of gradual disempowerment holds that the core driving force behind the loss of human influence is that machines have become more competitive alternatives to humans in almost all social functions, covering economic labor, decision-making, artistic creation, and even emotional companionship.
50%UnverifiedThe author of this article admits that the gradual disempowerment argument is indeed anthropocentric, and that similar arguments could also be applied to animal welfare as well as to existing AI systems (if they can be regarded as moral patients).
50%UnverifiedThe author of this article admits that the original text sometimes exaggerated its novelty, because the risk of AI-driven totalitarianism had been discussed for many years before the publication of "Gradual Disempowerment."
50%UnverifiedThe author of this article argues that the contribution of the theory of gradual disempowerment lies in revealing the hiddenness and danger of the path by which humans gradually cede control in the process of pursuing efficiency and competitiveness.
50%UnverifiedBentham's Bulldog and John Halstead raised criticisms of the theory of gradual disempowerment, including questioning whether disempowerment itself constitutes harm, whether a fully automated economy would really detach from humans, and whether competitive pressure would really intensify.
50%