On 27 September 2026, 86 of 908 x402 Bazaar sites refused the AI training crawlers with a 403, while 83 of them still let answer crawlers in.
On 27 September 2026 we checked the 927 sites listed in the x402 Bazaar — the public directory of services that sell to AI agents over x402 — the way AI crawlers read a page: plain HTTP, no browser, no JavaScript. 86 of the 908 that answered (9%) turned away the AI training crawlers GPTBot and ClaudeBot with 403 Forbidden. 83 of those 86 let in the crawlers that fetch pages for answers: OAI-SearchBot, ChatGPT-User, Claude-User and PerplexityBot.
Read the full post on 402registry: https://402registry.com/blog/x402-sites-turn-claudebot-away?utm_source=devto&utm_medium=social
Top comments (0)