DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
YouTube Crawler: Data Extraction vs. Video Downloads

YouTube Crawler: Data Extraction vs. Video Downloads

Comments 1
7 min read
Your eBay scraper is billing customers for adverts

Your eBay scraper is billing customers for adverts

Comments
4 min read
Build or Buy a Price Scraper? Start With Failure Modes

Build or Buy a Price Scraper? Start With Failure Modes

Comments
5 min read
Getting YouTube transcripts without the Data API — and why "translate to 100+ languages" is usually broken

Getting YouTube transcripts without the Data API — and why "translate to 100+ languages" is usually broken

Comments 1
4 min read
How Scraping AI Extracts Structured Data from Any Webpage Without CSS Selectors

How Scraping AI Extracts Structured Data from Any Webpage Without CSS Selectors

2
Comments 1
4 min read
Why did a Brazil result not tell me anything reliable about LATAM?

Why did a Brazil result not tell me anything reliable about LATAM?

Comments
2 min read
CĂłmo solucionar el error \"Enable JavaScript and cookies to continue\"

CĂłmo solucionar el error \"Enable JavaScript and cookies to continue\"

Comments
3 min read
Three Lines to Draw Before You Scrape Instagram

Three Lines to Draw Before You Scrape Instagram

Comments
7 min read
Give an AI Agent a Browser: From Instructions to Actions

Give an AI Agent a Browser: From Instructions to Actions

Comments 1
6 min read
How to benchmark scraping APIs for AI agent workloads

How to benchmark scraping APIs for AI agent workloads

Comments
5 min read
Why Scrapers Still Hit HTTP 429 After Adding Delays

Why Scrapers Still Hit HTTP 429 After Adding Delays

Comments
4 min read
CĂłmo solucionar el error \"Enable JavaScript and cookies to continue\"

CĂłmo solucionar el error \"Enable JavaScript and cookies to continue\"

Comments
3 min read
I cut my scraper's price 6x — the pricing mistake I'd made

I cut my scraper's price 6x — the pricing mistake I'd made

Comments
3 min read
The day our scraper fleet shipped nothing — and the afternoon it shipped three

The day our scraper fleet shipped nothing — and the afternoon it shipped three

Comments
4 min read
Your Scraper's Retry Logic Is Probably Making the Block Worse

Your Scraper's Retry Logic Is Probably Making the Block Worse

Comments
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.