Anthropic’s future depends on putting humanity’s future in danger
Until fairly recently, Anthropic was best known as OpenAI’s quirky, safety-minded junior competitor, founded by breakaway OpenAI staff who believed that their former employer was pushing AI development too recklessly in pursuit of profits. Now the company is on the verge of becoming one of the most valuable on the stock market. Anthropic plans to go public on Wednesday at a valuation of $1.4 trillion. It promises investors that it will generate huge returns by relentlessly pursuing the very strategies that its leaders and employees believe could lead to superintelligent AI wiping out all of humanity. Anthropic’s stated commitment to safety has always existed in tension with its pursuit of profit. Its IPO is a clear sign that the pursuit of profit is winning.
Anthropic’s business model is based on having the most sophisticated AI models and charging businesses a lot for their use. The company’s Claude products, especially the software-development tool Claude Code, are widely considered the best on the market, and companies have lined up to pay for them. Over the past year, Anthropic’s quarterly revenue has increased more than tenfold, from $1.4 billion to $17 billion—more than six times the rate that Google’s and Meta’s revenues rose in the year leading up to their IPOs. It began turning a profit in the second quarter of 2026.
But, as the company acknowledges in the “risk factors” section of its IPO filing, its further growth hinges on staying ahead of the competition. Revenue growth slowed in the third quarter of this year, largely because OpenAI and Chinese companies released models nearly as capable as Claude, eating into Anthropic’s market share. “Anthropic really can’t afford to stand still,” Jay Ritter, the director of the IPO Initiative at the University of Florida, told me. “If they stumble, the industry could end up in a situation like with airplanes, where Boeing and Airbus engage in price wars and neither ends up very profitable.”
To preserve its advantage, Anthropic has made roughly $900 billion in commitments to purchase the chips and build the data centers that it needs in order to keep improving its models. About half of that bill comes due before 2030. Private money from a handful of institutional investors simply isn’t enough to fund that kind of spending binge. So Anthropic is turning to public markets instead.
Anthropic’s plan for all that money revolves around using current AI to build better future AI, which will in turn create even better versions of itself, and so on—a process known as recursive self-improvement. The company is explicit that achieving this milestone first is its big bet. “If our competitors more effectively leverage AI to enhance their own innovation cycles, we risk falling progressively further behind,” its IPO filing explains.
But in the very same document, Anthropic acknowledges that recursive self-improvement could cause immense and perhaps even apocalyptic harm. “Concerns have been raised,” it states, “that sufficiently advanced AI systems could, if not developed, deployed, and operated with appropriate safeguards, oversight, and security measures, pose catastrophic or existential risks to humanity.” The document goes on to argue that “these risks will increase as AI systems substantially automate AI research and development.” Translation: The approach that we’ve staked our business on might be the thing that ends up killing us all. [Continue reading…]