Brewster Kahle writes:

In 1996, during the early years of the web, I could see that those of us who were participating online were creating an extraordinary new record of human activity—and allowing it to disappear almost as quickly as we made it.

The web was becoming the place where government officials made promises, journalists published information in the public interest, and ordinary people shared ideas and documented their lives. Yet it was fragile—equal parts consequential and ephemeral.

Many people assume that once something is published online, it will remain forever retrievable. The saying that “the internet never forgets” has produced a dangerously false sense of permanence. In reality, the internet forgets continuously. Websites are constantly revised, deleted, and abandoned altogether.

This is why, 30 years ago, I founded the Internet Archive. I wanted to build a mechanism for permanence in the internet age. Soon after that, I helped build the Internet Archive’s most-used resource, the Wayback Machine, a system that would preserve webpages as they appeared at any one moment in time, allowing future readers to return to those moments. The idea was simple but urgent: If the internet was going to become humanity’s principal publishing platform, then it needed what every great publishing system that came before it had needed. It needed a library.

People all over the world use the Wayback Machine all the time. What began as an effort to preserve the web has become an essential tool for journalists, researchers, historians, and the broader public.

Yet the future of this tool has become extremely vulnerable. The New York Times is now blocking the Internet Archive’s ability to preserve its articles. The Guardian has restricted our access to its published articles and removed articles from some of the Wayback Machine’s interfaces. USA Today and a growing number of other news organizations have also placed barriers in the path of web archivists (even, yes, The Atlantic). As of May 2026, Harvard’s Nieman Journalism Lab had identified more than 340 local-news sites that were limiting the Internet Archive’s ability to preserve their journalism.

The publishers taking these steps have all pointed to one reason: the unauthorized use of their work by AI companies to train large language models. They complain that our library serves as a back door around paywalls, licensing negotiations, and technical restrictions. The Times has said that it is blocking us because the Wayback Machine allegedly provides “unfettered access” to its work. But this fear-based approach does not take into account that the Internet Archive is taking steps to prevent AI companies from scraping the materials we preserve. [Continue reading…]