Reddit, Reuters and other publishers weigh blocking Google crawlers as AI summaries cut search traffic

Reddit, Reuters and other publishers weigh blocking Google crawlers as AI summaries cut search traffic

N
News Editor
2026-07-26 03:23:52
Google’s latest earnings showed search advertising revenue hit a record $63.271 billion, up 17% year over year, even as several major U.S. news publishers saw sharp declines in organic search traffic. That contrast is driving a new standoff between publishers and Google. Reddit, Reuters, Politico and The Economist are among the media groups reported to be considering limits on Google’s access, arguing that AI-generated search summaries are keeping users on Google’s results page instead of sending them to original sources. Data cited in the report shows why publishers are alarmed: when no AI summary appears, 15% of users click a traditional link; with an AI summary, that falls to 8%, while just 1% click links embedded inside the summary. The problem is compounded by the fact that Google uses the same crawler infrastructure for search indexing and AI-related data collection, leaving publishers with no simple way to block one while preserving the other. Reddit’s existing annual licensing deal with Google, worth about $60 million, is now nearing expiration, and renewal talks remain ongoing.
GoogleAI summariesRedditReuterspublisher trafficsearch adspolicy regulation

Google reported record quarterly search advertising revenue of $63.271 billion, up 17% from a year earlier. At the same time, several established U.S. news sites have suffered steep drops in organic search traffic, pushing publishers including Reddit, Reuters, Politico and The Economist to consider limiting or blocking Google crawlers.

The tension comes from a simple shift in how search works. Google is increasingly keeping users on the results page through AI summaries instead of sending them out to publishers’ websites. Links still appear below those summaries, but many users do not click them.

An old exchange between publishers and Google is breaking down

For roughly two decades, publishers and Google operated under an unwritten bargain. Google crawled the web, indexed content and surfaced it in search. In return, websites received traffic. The relationship was never equal, but it remained commercially workable for both sides.

That arrangement is now under pressure. In the July 25, 2026 episode of The Vergecast, The Verge editor-in-chief Nilay Patel discussed a string of “Google Zero” developments with host David Pierce.

Patel coined the term “Google Zero” in 2024 to describe the point at which Google Search stops sending traffic to third-party websites. In practical terms, it means a site no longer receives visitors from search and begins to disappear as a traffic destination inside Google’s ecosystem. What once sounded exaggerated is now, according to the report, being written into publisher strategy decks as a planning assumption for near-zero search traffic.

Traffic declines are already visible across major outlets

Semrush data covering U.S. organic search traffic from June 2025 to June 2026 shows broad weakness across major publishers:

  • USA Today’s national site fell nearly 50%
  • Business Insider dropped more than 85%
  • CNN declined about 25%
  • Politico fell 23%

Research from Pew Research Center helps explain the drop. When a search results page does not include an AI summary, 15% of users click a standard link. When an AI summary is present, that figure drops to 8%. Only 1% click a link inside the AI summary itself. In effect, Google is placing the answer at the top of the page, resolving the user’s question before the publisher’s site is ever opened. The original source remains visible, but often as a reference that draws little traffic.

One crawler, two jobs

For publishers, the hardest part is structural. The same Google crawler system is used for both search indexing and AI-related data collection. That leaves publishers with little room to block AI use while preserving search visibility.

If they cut Google off, they may also give up what remains of their search traffic and risk disappearing from search results altogether. The report frames this as the central contradiction of the dispute: publishers do not have a clean “block AI, keep search” option. In many cases, the choice is between accepting both or rejecting both.

Reddit’s deal is nearing expiration

Reddit ran into this issue early. In 2024, the company signed an annual licensing agreement worth about $60 million that allowed Google to use Reddit content to train AI models.

That agreement is now close to expiring, and renewal talks are still underway. Reddit is reportedly considering not renewing the deal and may even block Google from crawling its content. After that possibility emerged, Reddit shares fell about 9% on July 22, 2026. The market reaction, as described in the report, suggests investors see content extraction for AI training as a serious risk, potentially more damaging to Reddit than the loss of some search traffic.

More large publishers are considering restrictions

Mike Reed, chief executive of USA Today Co., told The New York Times, “It’s time to take a stand and say enough is enough.”

In a July 20, 2026 report, The New York Times said Reuters, Politico, The Economist and People Inc., alongside USA Today Co., were also considering restricting or blocking Google’s access. The common thread is scale. These organizations may be large enough to absorb traffic losses, but not large enough to ignore the cost of having their content taken and used by AI systems without a meaningful return.

The traffic-for-content model is under strain

Cloudflare chief executive Matthew Prince had previously warned that AI summaries could damage the internet’s business model. The report argues that the traditional sequence was straightforward: content generated traffic, and traffic generated advertising revenue. AI summaries interrupt that cycle. Content is still scraped, learned from and used to answer queries, while the traffic that once flowed back to the source is reduced or disappears.

The article says the most likely outcome is not a dramatic showdown but a gradual shift toward one-off licensing arrangements between Google and larger publishers, similar to Reddit’s existing deal. Smaller websites, with less leverage, may have far fewer options as search traffic continues to erode.

This article was originally published by Bit.Fan. For more cryptocurrency news and market insights, visit www.bit.fan.
1100

Disclaimer:

The market information, project data, and third-party content displayed on this platform are for industry information sharing only and do not constitute any form of investment advice or return commitment.

Cryptocurrency trading carries high risks. Users should fully assess their risk tolerance and make independent decisions. All profits, losses, and legal responsibilities are borne by the users themselves.