"We're on track to hand control of the most powerful weapon the world has ever built to the weapon itself."

Former UK Defence Secretary and ControlAI advisor Lord Browne of Ladyton, closing our London event the night before @alexsobel introduced our bill to ban superintelligent… pic.twitter.com/dPzvsFOqQB

— ControlAI (@ControlAI) September 22, 2026

ControlAI is a non-profit organisation that works to prevent the extinction risk posed by superintelligence and to secure a great future for humanity.

Ezra Klein writes:

There’s a chasm right now between how artificial intelligence feels to most of us who use it and how A.I. feels out at the experimental frontier of the technology. This difference between what we see and what the A.I. labs have coming — what they’re already building — is the key to understanding why so many of the people who work at these companies seem so afraid of what they’re doing.

But taking their warnings seriously doesn’t just mean doing what they say and stopping where they say to stop. The language that’s taken hold in both Silicon Valley and Washington is a phrase these companies chose: Pace the frontier. But pacing the frontier isn’t enough.

Walking quickly off a cliff is only marginally better than sprinting off one. Human beings need to control the frontier, and controlling the frontier means stopping the labs from doing something they are on the cusp of doing: recursive self-improvement, the process by which A.I.s begin autonomously building and improving new generations of more powerful A.I.s at ever more rapid speeds. We are not close to having sufficient control of the A.I. systems we have now to unleash them to build the A.I. systems of tomorrow. [Continue reading…]