DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Unblock: a Claude Code skill that keeps trying when a web lookup fails

Unblock: a Claude Code skill that keeps trying when a web lookup fails

Comments 1
2 min read
Your scraper is identified before it sends a single request

Your scraper is identified before it sends a single request

1
Comments 1
8 min read
Google Trends API: the 200 OK that means you got soft-blocked

Google Trends API: the 200 OK that means you got soft-blocked

Comments
4 min read
YouTube Crawler: Data Extraction vs. Video Downloads

YouTube Crawler: Data Extraction vs. Video Downloads

Comments 1
7 min read
Your eBay scraper is billing customers for adverts

Your eBay scraper is billing customers for adverts

Comments
4 min read
Build or Buy a Price Scraper? Start With Failure Modes

Build or Buy a Price Scraper? Start With Failure Modes

Comments
5 min read
Getting YouTube transcripts without the Data API — and why "translate to 100+ languages" is usually broken

Getting YouTube transcripts without the Data API — and why "translate to 100+ languages" is usually broken

Comments 1
4 min read
How Scraping AI Extracts Structured Data from Any Webpage Without CSS Selectors

How Scraping AI Extracts Structured Data from Any Webpage Without CSS Selectors

2
Comments 1
4 min read
Why did a Brazil result not tell me anything reliable about LATAM?

Why did a Brazil result not tell me anything reliable about LATAM?

Comments
2 min read
Cómo solucionar el error \"Enable JavaScript and cookies to continue\"

Cómo solucionar el error \"Enable JavaScript and cookies to continue\"

Comments
3 min read
Three Lines to Draw Before You Scrape Instagram

Three Lines to Draw Before You Scrape Instagram

Comments
7 min read
Give an AI Agent a Browser: From Instructions to Actions

Give an AI Agent a Browser: From Instructions to Actions

Comments 1
6 min read
How to benchmark scraping APIs for AI agent workloads

How to benchmark scraping APIs for AI agent workloads

Comments
5 min read
Why Scrapers Still Hit HTTP 429 After Adding Delays

Why Scrapers Still Hit HTTP 429 After Adding Delays

Comments
4 min read
Cómo solucionar el error \"Enable JavaScript and cookies to continue\"

Cómo solucionar el error \"Enable JavaScript and cookies to continue\"

Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.