For nearly three decades, the Wayback Machine has been the internet’s safety net. When a government agency quietly deleted a policy document, a journalist could find the original on archive.org. When a company changed its terms of service without telling anyone, the old version was still there. When a news article was edited after publication to remove inconvenient facts, the original was preserved.
The Wayback Machine archived over one trillion web pages. Researchers, journalists, historians, lawyers, students, and everyday internet users have relied on it as the definitive backup of the public web.
In 2025 and 2026, that safety net developed serious holes.
Major publishers, including The New York Times, The Guardian, Reddit, and more than 340 local news outlets across nine countries, have moved to block the Wayback Machine’s crawlers from accessing their content. Page captures among news publications dropped 87 percent between May and October 2025 alone. The tool that everyone assumed was preserving the web is now being actively prevented from doing so by the very organizations whose content most needs preserving.
This guide explains exactly what happened, why the Wayback Machine cannot be the sole solution anymore, and what practical steps you can take right now to build your own reliable web archive.
What Happened: The AI Copyright War Caught the Wayback Machine in the Crossfire
The Wayback Machine did not change. The web around it did.
As AI companies raced to build and train large language models, they needed enormous quantities of high-quality text. Archived news content is exactly that: structured, dated, attributed, professionally written text accumulated over decades. The Internet Archive’s massive repository of over one trillion archived pages made it an attractive source for AI training pipelines.
A 2023 analysis by The Washington Post found that data from the Internet Archive had appeared in major AI training datasets. The domain for the Wayback Machine was among the top 200 most represented sources in the C4 dataset used to train Google’s T5 model and Meta’s Llama models. Publishers who were already filing copyright lawsuits against AI companies saw the Wayback Machine as a gap in their defences. The result: major publishers began blocking the Wayback Machine’s crawlers from accessing their content, not because they oppose archiving in principle, but because they could not distinguish between the Archive’s preservation mission and AI companies using the Archive as a training data pipeline.
The New York Times spokesperson stated directly: “The issue is that Times content on the Internet Archive is being used by AI companies in violation of copyright law to directly compete with us.” The Times implemented what the Wayback Machine’s own director described as a “hard block”, going beyond standard robots.txt conventions to actively prevent archival access.
Reddit announced in August 2025 that it would block Wayback’s crawlers. USA Today Co.’s decision to block access effectively removed hundreds of local newspapers from the historical record simultaneously. The Guardian restricts access to its journalism. The Financial Times blocks broadly.
The Wayback Machine’s director, Mark Graham, described the situation clearly: “We are collateral damage.”
The stakes are bigger than one tool.
Wikipedia links to over 2.6 million news articles preserved by the Wayback Machine across 249 languages. Courts have used archived pages as evidence. Journalists have used them to prove government agencies changed official statements. When publishers block archival access, they are not just limiting one tool; they are removing those pages from the historical record entirely. As EFF put it: “Sacrificing the public record to fight those battles would be a profound, and possibly irreversible, mistake.”
Beyond the Blocking: The Wayback Machine’s Technical Limits
Even before publishers began blocking its crawlers, the Wayback Machine had inherent limitations that many users did not fully understand. The blocking crisis has made these gaps more consequential, but they existed before it.
1. It only crawls what is publicly accessible
The Wayback Machine cannot archive content behind logins, paywalls, or authentication walls. A news article that requires a subscription, a government portal that requires an account, and a research database that requires institutional access, none of these are archived. If the page you need requires any form of login, the Wayback Machine cannot help.
2. Modern JavaScript-heavy pages archive incompletely
The web of 2026 is very different from the web of 2001 when the Wayback Machine was launched. Modern websites built on React, Vue, Angular, and similar frameworks render their content dynamically through JavaScript execution. When the Wayback Machine’s crawler visits these pages, it often receives an empty HTML shell, the structure of the page without the actual content, which only loads after JavaScript runs. The archived version of many modern pages is therefore incomplete, showing a layout without content.
3. Crawl frequency is unpredictable
The Wayback Machine does not archive every page every day. Popular pages may be archived frequently. Obscure pages may be archived once a year or less. If a page you need was only archived six months before it was changed or deleted, the version you find may be significantly out of date. You cannot rely on the Wayback Machine to have captured any specific page at any specific time.
4. robots.txt exclusions are respected
The Wayback Machine has historically respected the robots exclusion standard; if a website tells crawlers to stay out via robots.txt, the Wayback Machine complies. This means any website that has ever added robots.txt exclusions may have gaps or complete absences in its Wayback Machine archive, regardless of the AI blocking situation.
5. The archive itself has been attacked
In October 2024, the Internet Archive suffered a major cyberattack that compromised 31 million user accounts and took the Wayback Machine offline for weeks. In November 2025, another disruption took the service temporarily offline. In May 2023, an AI company’s automated requests caused a server overload that took the Archive offline temporarily. A service that depends on a single nonprofit organization operating on a limited budget carries inherent fragility risks.
The fundamental limitation
The Wayback Machine is a passive archiver. It crawls the web on its own schedule, archives what it can access, and makes those archives available to the public. It does not archive on demand for specific users, cannot access gated content, cannot guarantee any specific page was captured, and cannot be relied upon in 2026 to have archived content from major news publishers. If you need a specific page archived, the only person you can rely on to do it is yourself.
What to Do Instead: Build Your Own Web Archive
The solution to the Wayback Machine’s limitations is the same solution that has always been available for anyone who needed to be certain a specific page was preserved: archive it yourself. When you convert a page to PDF the moment you find it, you create a permanent archive, completely under your control, immediately available, and independent of any third-party service’s crawl schedule, robots.txt policies, or operational stability.
Method 1: Convert to PDF immediately using webs2pdf.com
The fastest, most reliable method for archiving any web page you find is to convert it to PDF immediately using webs2pdf.com. This creates a complete, permanent snapshot of the page exactly as it appears at that moment, with full content, all images, and no dependency on any third-party archive’s crawl schedule.
- Find the web page you want to preserve.
- Copy the URL from your browser address bar.
- Paste it into webs2pdf.com and click Convert.
- Download the PDF. You now have a permanent, offline-readable, shareable archive of that page exactly as it appeared.
Why PDF is the right archiving format
A PDF preserves the visual appearance of a web page, the full text content in searchable and selectable form, the layout and structure that provide context, and any images that appeared on the page. Unlike a screenshot, the text is searchable and can be copied. Unlike a bookmark, it does not break when the original page changes. Unlike the Wayback Machine, it does not depend on a crawl having happened at the right time. A PDF archive you created yourself is the most reliable record of what a web page contained at a specific moment.
Method 2: Archive news articles immediately upon discovery
The most critical archiving habit is timing. When you find a news article, research paper, government document, or any web page that matters to your work or research, archive it immediately. Not later today. Not when you get to it. Now.
Every hour that passes between when you find a page and when you archive it is an hour in which the page could be updated, corrected, or deleted without notice. The Wayback Machine’s value was that it captured pages you had already decided you no longer needed to capture. That passive safety net is shrinking. Your active archiving habit needs to fill the gap.
Method 3: Set up scheduled automatic archiving for critical sources
For pages you monitor regularly, a competitor’s pricing page, a regulatory agency’s guidance document, a government portal you track, automated scheduled archiving removes the reliance on both memory and the Wayback Machine. Using webs2pdf.com’s API connected to an automation tool like Zapier, Make, or n8n, you can schedule automatic PDF conversions of specific URLs at regular intervals. This creates a rolling archive of how those pages change over time.
Method 4: Use browser extensions for one-click saving
Browser extensions that add a “Save as PDF” button to your browser toolbar make the archiving action as fast as possible. When you are reading a page you want to preserve, one click triggers the PDF save rather than requiring you to navigate to a separate tool. For users who archive frequently, this reduces the friction enough that the habit becomes automatic.
Wayback Machine vs Self-Archiving: A Clear Comparison
| Factor | Wayback Machine (2026) | Self-archive via Webs2PDF |
| News publisher content | Increasingly unavailable, 340+ outlets blocking | ✓ Captures any publicly visible page immediately |
| On-demand archiving | ✗ Passive crawl only, no guarantee | ✓ You control exactly what and when is archived |
| JavaScript-heavy pages | Incomplete, often captures the shell without content | ✓ Full render before PDF generation |
| Login-gated content | ✗ Cannot access | ✗ Cannot access (same limitation) |
| Specific timing | No guarantee page was crawled when you needed it | ✓ Archived at the exact moment you choose |
| Availability | Dependent on a single nonprofit, it has gone offline before | ✓ Your PDF is permanent and locally stored |
| robots.txt compliance | Respected excluded sites are not archived | ✓ Not affected by robots.txt |
| Cost | Free | Free for individual conversions at webs2pdf.com |
| Long-term reliability | Uncertain given the publisher blocking trend | ✓ File exists on your own storage indefinitely |
Who Is Most Affected by the Wayback Machine Crisis
Journalists and fact-checkers
Journalists who use the Wayback Machine to verify that a website or official statement was changed after an event, one of the tool’s most powerful uses, now find that the major news outlets they most need to monitor are exactly the ones that have blocked archival access. A journalist investigating whether a newspaper edited a story after publication cannot use the Wayback Machine to prove it if that newspaper has blocked the archive’s crawlers.
Academic researchers
Research papers cite web sources that eventually go offline. The Wayback Machine has been the standard fallback citation for “Accessed on date X” references. With major publication domains now excluded from the archive, researchers can no longer assume the Wayback Machine has a backup of the source they cited. Self-archiving at the time of research is now the only reliable approach for academic citation integrity.
Legal professionals
Courts have accepted Wayback Machine archives as evidence of what a website said at a specific time. With major publishers blocking archival access, that evidence source is becoming unreliable for content from those publishers. Legal professionals who need to document online statements, terms of service, or published claims must now create their own contemporaneous PDF records rather than relying on a future Wayback Machine lookup.
Local news communities
USA Today Co.’s decision to block Wayback Machine access removed more than 200 local news outlets from the historical record simultaneously. These are the outlets that cover local court cases, city council decisions, school board controversies, and community events, content that is already fragile, published by organizations with limited resources, and represents exactly the kind of primary local record that needs preservation most. Those communities’ digital history is now effectively unarchived.
A Practical Archiving System for 2026
The shift from passive reliance on the Wayback Machine to active self-archiving requires a simple system. Here is how to build one:
- Archive immediately, not later. The moment you find a page that matters, a news article, a regulatory document, a legal filing, or a government statement, convert it to PDF before doing anything else. The window between “found it” and “lost it” can be hours.
- Name your files with source and date. NYT_ClimatePolicy_2026-07-01.pdf tells you everything you need to know when you search your archive six months later. A filename like download.pdf tells you nothing.
- Organize by topic, not by date. Store your archives in topic folders: Legal_research, Competitor_monitoring, Regulatory_documents, News_articles. Within each folder, files named with dates sort themselves automatically.
- Use cloud storage you control. Store your PDF archives in your own cloud storage (Google Drive, Dropbox, OneDrive) rather than relying on any third-party archiving service. The Wayback Machine situation is a reminder that even trusted, mission-driven organizations face pressures that can affect their service.
- For high-stakes content, add a capture log. For legally or professionally significant archives, maintain a simple spreadsheet recording: the URL, the capture date and time, what the page contained, and why it was archived. This creates a documented chain of custody alongside the PDF itself.
- Set up automated archiving for critical pages. For pages you monitor regularly, use webs2pdf.com’s API with a scheduling tool to create automatic weekly or monthly snapshots. You will never miss an update you should have caught.
Frequently Asked Questions
Is the Wayback Machine going to shut down?
As of July 2026, the Internet Archive and Wayback Machine remain operational. The service has not shut down, but it has faced significant challenges: major cyberattacks in October and November 2025, legal battles over its digital lending library, and the publisher blocking trend discussed in this article. The Archive continues to operate and to fight for its preservation mission, but its ability to access and archive content from major publishers is significantly diminished compared to previous years.
Can I still use the Wayback Machine?
Yes. The Wayback Machine remains a valuable tool for content that has not been blocked. For older content, non-news websites, historical research, and any domain that has not explicitly blocked the Archive’s crawlers, it continues to work as before. The gaps are in news publisher content, Reddit content, and any other site that has added blocking rules. For your current, active research and archiving needs, supplementing it with your own PDF archiving is the most reliable approach.
Why are news publishers blocking an archiving nonprofit?
Publishers are not targeting the Archive specifically; they are responding to the broader AI training data crisis. Evidence from a Washington Post analysis showed that Wayback Machine content had appeared in major AI training datasets. Publishers who are engaged in copyright lawsuits against AI companies view the Archive as a gap in their defences. The Archive’s director has called publishers’ concerns “unfounded” given the Archive’s existing controls against bulk downloading, but publishers have moved to block access preemptively regardless.
Does webs2pdf.com respect website blocking rules?
Webs2pdf.com converts publicly accessible web pages, pages that any visitor can access in a browser without a login. It operates as a user-initiated tool, not as an automated crawler. You provide a specific URL, the tool renders and converts that page, and you download the result. It does not crawl websites autonomously, and it does not operate like the large-scale automated bots that publishers are concerned about. For any content behind a paywall or login, you cannot access the content just as you cannot without credentials.
What is the best alternative to the Wayback Machine for personal use?
For personal use, saving specific pages you find and want to keep, the most practical alternative is immediate PDF archiving via web to PDF. It requires no account, works on any public page, produces a complete high-quality PDF, and the result is stored on your own device and cloud storage rather than a shared public archive. For institutional or large-scale archiving needs, tools like Archive-It (the Internet Archive’s subscription service for organizations), Conifer, or Webrecorder offer more structured approaches to building curated web archives.
Conclusion
The Wayback Machine is not going away. Its mission is important, its archive is extraordinary, and it remains a valuable resource for content that has not been blocked. But in 2026, it can no longer be treated as the automatic backup of everything on the public web.
More than 340 publishers have blocked it. Its crawls are imperfect on modern JavaScript-driven pages. Its schedule cannot be controlled. And as a single organization facing legal battles, cyberattacks, and the pressures of the AI copyright war, its operational continuity cannot be guaranteed.
The web is fragile. Content disappears faster than any single archiving tool can capture it. A Pew Research study found that 38 percent of webpages from 2013 were no longer accessible a decade later. The Wayback Machine preserved many of those pages. It cannot preserve them all.
The most reliable archive is the one you create yourself, at the moment you find something worth keeping. Paste the URL into webs 2 pdf, download the PDF, and store it somewhere you control. That page is now yours permanently, regardless of whether any publisher blocks any crawler, any tool goes offline, or any AI company sends a million requests per second to an overloaded server.
Start archiving at webs2pdf.com, free, immediate, and completely independent of anyone else’s infrastructure.
