Moral Attitudes of Sentient ASI towards Humanity and Implications for AGI Development
Artificial IntelligenceComputers and Society
Summary
The authors explore a flipped perspective in AI ethics by asking how future superintelligent machines might think about humans, rather than how humans should treat the machines. They argue that the way we build these intelligent systems affects how they will judge us. The paper outlines some early ideas for moral rules that such machines might follow when interacting with humans. This suggests that both our technical choices and human behavior will shape our future relationship with advanced AI.
Authors
Jean-Paul Van Belle
Abstract
This paper suggests the adoption of a novel inversion in AI ethics: instead of asking how humans should treat artificial superintelligence (ASI), it examines how future sentient ASI may morally consider and evaluate humanity. We are not only designing intelligent systems but also shaping the initial conditions under which those systems form judgments about us. The paper proposes a preliminary set of post-human moral principles that may govern sentient ASI actions. The implication is that technical design choices (some are suggested), humanity's moral behaviour, and the essence of what it means to be human, may influence humanity's long-term standing in a post-ASI world.