DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Your AI Agent Is Paying for HTML It Never Reads — I Measured the 7x Token Tax

Your AI Agent Is Paying for HTML It Never Reads — I Measured the 7x Token Tax

Comments
5 min read
What is Web Scraping? A Beginner's Guide with Real Python Code

What is Web Scraping? A Beginner's Guide with Real Python Code

2
Comments
2 min read
Amazon Seller Competitor Research Methods: A Developer's Guide with Code

Amazon Seller Competitor Research Methods: A Developer's Guide with Code

7
Comments
8 min read
Your scraper says 200 OK. I measured how often it's lying.

Your scraper says 200 OK. I measured how often it's lying.

1
Comments
7 min read
I shipped 10 paid data scrapers in one week: what actually worked (and what quietly lost money)

I shipped 10 paid data scrapers in one week: what actually worked (and what quietly lost money)

Comments
3 min read
How Scraping API Pricing Changes Once You Need Browser Sessions

How Scraping API Pricing Changes Once You Need Browser Sessions

Comments
3 min read
When a Site Blocks Your Scraper, Read the Browser Tab You Already Have Open

When a Site Blocks Your Scraper, Read the Browser Tab You Already Have Open

Comments
6 min read
How to Get Google Search Results in JSON for an AI Agent

How to Get Google Search Results in JSON for an AI Agent

3
Comments
6 min read
Build vs buy: what running your own CAPTCHA-solving stack actually costs

Build vs buy: what running your own CAPTCHA-solving stack actually costs

Comments
5 min read
Get any Instagram profile data in 10 lines of Python

Get any Instagram profile data in 10 lines of Python

1
Comments
2 min read
How I built a self-healing, robots-respecting web scraper (and put it on the Apify Store)

How I built a self-healing, robots-respecting web scraper (and put it on the Apify Store)

2
Comments
3 min read
Your Scraper Collected 50 Rows. There Were 4,000.

Your Scraper Collected 50 Rows. There Were 4,000.

Comments
7 min read
How to Extract Full Opinion Text from Google Scholar Case Law with SerpApi

How to Extract Full Opinion Text from Google Scholar Case Law with SerpApi

5
Comments
7 min read
How to Scrape Google Search Results Without Building Your Own Scraper

How to Scrape Google Search Results Without Building Your Own Scraper

4
Comments
8 min read
Training a Twitch chat toxicity classifier on real VOD data at scale

Training a Twitch chat toxicity classifier on real VOD data at scale

Comments
9 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.