(3/3) The Dangers of ASI

As a LessWrong essay sketches it, humanity faces a turning point when artificial superintelligence surpasses our capability and inevitably takes control—whether that handoff is voluntary or sudden. The author maps the possible futures. At the darkest end: extinction, if superintelligence decides we're expendable. Short of that, we might be left behind like ants, too primitive to understand its reasoning. Or elevated to something like pets: cared for tenderly, but incapable of grasping the decisions made on our behalf. There's an optimistic path, too: superintelligence might solve the problems we can't—poverty, disease, even cruelty. But the cost is real. By eliminating suffering, superintelligence might also eliminate the virtues born from hardship: charity, heroism, sacrifice, privacy. We might gain security and abundance. We might lose autonomy, and the meaning that struggle gave us. The essay's core question: what remains of being human when superintelligence solves all our problems?

Listen to this story

Hear this and more stories in a personalized audio briefing.

Open The Chonkerton