Cloudflare Reports Bots Surpass Humans, Now Generating 57.5% of HTML Traffic

For the first time, automated bots are generating more web traffic to HTML pages than humans, accounting for about 57.5%, according to Cloudflare.

This shift is driven by a surge in AI crawlers and was revealed by recent improvements in traffic measurement technology.

This trend increases server costs and ad fraud, pressuring publishers to adopt new "pay-to-crawl" models to monetize bot traffic.

A significant milestone has just been crossed on the internet: automated bots now generate more traffic than humans.

On June 5, 2026, Cloudflare's CEO revealed that bots accounted for roughly 57.5% of global requests to HTML web pages over the past week. This isn't just a number; it's a symbolic tipping point that signals a fundamental shift in the web's economy and security landscape. For the first time in Cloudflare's data, automated traffic has definitively surpassed human activity.

So, why is this happening now? The causal chain points to two main factors. First, the explosive growth of AI crawlers, which constantly scour the web for data to train large language models, has dramatically increased automated traffic. Second, our ability to see this shift has improved. Cloudflare recently upgraded its Radar measurement tools, allowing for a clearer distinction between bot and human traffic specifically for HTML pages, which surfaced this new reality.

This new majority brings significant economic pressure. When bots crawl a website, they use up server resources, increasing costs for the publisher. However, unlike human visitors, they don't click on ads or follow referral links, which is how most websites make money. This mismatch has led to the rise of a new concept: 'pay-to-crawl'. The idea is that AI companies should pay for the data they collect, creating a new revenue stream for publishers to offset their costs.

Cloudflare's data doesn't stand alone. Other industry reports from companies like Imperva and Akamai have been flagging a similar surge in bot activity for over a year. Furthermore, new regulations like the EU's AI Act, set to take effect in August 2026, are adding to the pressure by requiring more transparency about AI training data. This regulatory tailwind is encouraging AI companies to formalize their data access through licensing deals. The era of free, unlimited crawling may be coming to an end.

Glossary
Bot: An automated software application that performs repetitive tasks over the internet.
Crawler: A type of bot, also known as a spider, that systematically browses the web, typically for the purpose of web indexing or data mining.
Pay-to-Crawl: A business model where website publishers charge bots, particularly those from AI companies, a fee to access and collect data from their sites.

Cloudflare Reports Bots Surpass Humans, Now Generating 57.5% of HTML Traffic

For the first time, automated bots are generating more web traffic to HTML pages than humans, accounting for about 57.5%, according to Cloudflare.

This shift is driven by a surge in AI crawlers and was revealed by recent improvements in traffic measurement technology.

This trend increases server costs and ad fraud, pressuring publishers to adopt new "pay-to-crawl" models to monetize bot traffic.

A significant milestone has just been crossed on the internet: automated bots now generate more traffic than humans.

Glossary
Bot: An automated software application that performs repetitive tasks over the internet.
Crawler: A type of bot, also known as a spider, that systematically browses the web, typically for the purpose of web indexing or data mining.
Pay-to-Crawl: A business model where website publishers charge bots, particularly those from AI companies, a fee to access and collect data from their sites.