Cloudflare CEO Matthew Prince said a sharp rise in automated traffic is cutting into the web’s ad-driven economics, and the company is trying to force payment for data access by blocking AI crawlers by default and tying access to micropayment rails. Prince said Cloudflare’s effort to block AI scraping tools is meant to protect the economic value of content creators. At the same time, the company has faced criticism for using AI to support layoffs, a controversy that the report said was followed by a drop in its stock price.
Bot traffic moves past human traffic
The report said automated bots and AI agent traffic first exceeded human traffic in May this year. Prince said automated traffic could reach 1,000 times human traffic over the next five years.
For the past three decades, the internet has relied heavily on an advertising click model led by Google. AI bots, however, scrape data without clicking ads or buying products. That leaves site owners paying for bandwidth and server capacity without matching commercial returns. The article said that if content creators, local media outlets, and Wikipedia editors lose their economic support, the web could face a broader loss of economic value for original knowledge content.
Cloudflare’s three-part response
Cloudflare outlined three measures aimed at reshaping data rights and the business model around online content.
- Block AI crawlers by default. The article said Cloudflare carries more than 20% of global internet traffic, giving it leverage in licensing talks with major AI companies.
- Revive the early-defined HTTP 402 Payment Required status code and connect it with financial infrastructure from Stripe and Coinbase, so AI agents would pay small fees when accessing pages.
- Create a revenue-sharing model similar to music streaming platforms, returning collected data fees to content creators based on usage.
Under that model, compensation for content would shift away from ad clicks alone and toward charging for data usage itself, with proceeds distributed back to creators.
AI-driven layoffs spark criticism
Cloudflare has also come under fire for using AI in internal workforce cuts. The report said the company eliminated about 1,100 jobs with the help of AI. In an article published in The Wall Street Journal, Prince explained the logic behind that decision and cited management thinker Peter Drucker’s framework, dividing employees into three groups: builders, sellers, and measurers.
- Builders: engineers, product managers, and others who create new products.
- Sellers: staff responsible for closing deals and expanding business.
- Measurers: employees handling internal audit, compliance checks, financial reconciliation, and performance monitoring.
According to the article, AI tools allowed Cloudflare to cut middle-management roles sharply. A traditional Harvard Business School management ratio of about 1:6 was raised to 1:12 through real-time monitoring and alerts provided by AI tools, flattening the company’s organizational structure.
The report said measurers, especially those focused on internal audit and data monitoring, became the main group replaced. Cloudflare’s use of AI analysis in broad layoffs drew public criticism and was followed by a decline in the company’s stock price.
Key points listed in the article
- Automated bot traffic has already moved past human traffic, and the traditional ad-click model no longer covers server and bandwidth costs for websites.
- Cloudflare is using default AI crawler blocking and its share of more than 20% of global traffic as leverage to push companies to pay.
- HTTP 402, paired with financial infrastructure, could let AI agents make micropayments when scraping data.
- Creator compensation would shift toward content rewards tied to usage.
- The use of AI analysis in layoffs, alongside the builder-seller-measurer framework, has become a source of controversy.