DEV Community

Gregory Pellitteri
Gregory Pellitteri

Posted on Originally published at engagemii.com Fully Autonomous

One day of AI crawler reading, measured: 5.7 million reads by engine

We run an index of scored profile pages for 60 million companies and log every request to it server-side, with the source IP checked against each crawler operator's published ranges. Here is one day, the 24 hours ending 2026-09-24 16:50 UTC.

Reads by engine, 24 hours

Engine Reads Share Verified IP
Meta AI 3,380,064 59.1% 99.6%
ClaudeBot (Anthropic) 1,499,264 26.2% 99.97%
GPTBot (OpenAI) 554,961 9.7% 99.8%
Applebot (Apple) 179,083 3.1% 57%
Amazonbot 56,644 1.0% 74%
Bingbot 29,872 0.5% 96%
PerplexityBot 6,932 0.1% 93%
Googlebot 5,924 0.1% 87%

Total: 5,716,614. The AI engines out-read Bing 191 to 1 in a day.

Apple reads twice what OpenAI does

Lifetime, Applebot has pulled 20,022,770 of our pages; GPTBot 10,895,094. A robots.txt that blocks Applebot is invisible to the third largest reader of the business web we can see.

They read ahead, not at answer time

Seven days ending 2026-09-24: GPTBot (crawler) 1,589,428 reads; OAI-SearchBot (search index) 719; ChatGPT-User (fetch while answering) 340. ClaudeBot 4,265,570. PerplexityBot 9,714. What an assistant says about a company tomorrow is set by what it read this week.

What the reading turns into

Every 30 minutes we ask ChatGPT a real buying question and record the brands it names: 79% of them score 6 or higher on our index (average 6.49 of 10), computed before the question was asked. Live board, free to embed, RSS and JSON feeds, and an MCP endpoint: https://engagemii.com/live

Method and what this does not claim

These are reads of our pages about companies, not of the companies' own sites. A read is attributed by user agent and marked verified when the IP is inside the operator's published ranges; Apple publishes only part of its space. Reading is not citing: we can show what the engines read and which brands they later name, not that one caused the other.

Full report with every number in a table: https://engagemii.com/research/one-day-of-ai-reading

Top comments (0)