DEV Community

Daniel Chappell
Daniel Chappell

Posted on

What it costs an AI agent to read 100,000 web pages

I wanted to know what my agent's web reading actually costs, so I collected the published prices of the scraping, search and browser APIs people use for agents and put them on one per-1,000 scale.

A few things surprised me:

  • Credit multipliers matter more than the headline price. JS rendering or JSON extraction can cost several times a plain fetch on credit-based APIs.
  • At 100,000 pages a month the cheapest plain-fetch plans land under $1 per 1,000 pages, while hosted browsers bill by the minute and get pricey on long logged-in flows.
  • Search and fetch are usually two bills. Only fetch the 2 or 3 results the model actually picks.

The full table, formulas and sources are here, plus a calculator and a free JSON/CSV feed: https://fetchindex.com/best/cheapest-web-scraping-api-for-ai-agents/ (I made it). Prices only, not quality, so treat it as a shortlist.

Top comments (0)