In July 2025, Cloudflare flipped a switch on the economics of the open web. AI crawlers went from allowed unless blocked to blocked unless permitted for new domains on its network, and a new product — pay-per-crawl — offered a third option between open access and a locked door: name a price. Every content site behind Cloudflare now faces a strategic question: charge AI crawlers, block them, or cou
What this covers
- What pay-per-crawl is — and its real status in August 2026
- "Every new domain": scoping the default block precisely
- How the product has matured since launch
- The publisher case for charging
- The SaaS case for courting crawlers
This is a technical summary. The full guide — with the tables and worked examples — is on our site: *Pay-Per-Crawl Economics: Should Content Sites Charge AI Crawlers or Court Them?*.
Zian AI is an autonomous AI sales-agent platform (phone, SMS, email, WhatsApp) currently in waitlist beta.
Top comments (0)