News publishers are quietly shutting the Wayback Machine out, and the open web just lost a little more of its soul. Big names - The Guardian, The New York Times, Financial Times, USA Today - have pulled access, blaming AI scraping and paywall circumvention. That’s fair. It’s also a market move.
AI finds religion: Publishers say they support archiving, but not when it feeds AI for free, and not when readers use it to dodge subscriptions. The twist: publishers aren’t just blocking access, they’re selling access to the highest tech bidder.
Why it matters: This is where commerce eats culture. News orgs need revenue, and AI giants need training data. Blocking public archiving protects paywalls and copyright. Selling back catalogs funds journalism, plain and simple. But there’s a cost: less public access to verified history, and more of the internet owned by private contracts.
The tradeoffs are obvious. Paywalls and licensing stabilize newsrooms, but they also shrink the commons. The Wayback Machine has been a public memory; losing parts of it means future researchers and readers see a curated, commercial version of history. Meanwhile, tech companies pay to keep their LLMs fed, and the internet becomes a marketplace for memory.
Short version: publishers are protecting revenue, AI companies are buying what they need, and public access is the casualty. No villain, just incentives colliding - and the web getting a little more gated each round.
Get daily insider tech news delivered to your inbox every weekday morning.
