DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
How to Build a Proxy Rotator in Python (That Actually Works)

How to Build a Proxy Rotator in Python (That Actually Works)

Comments 2
3 min read
Scraping the Meta Ad Library in 2026: cursors, one-shot browsers, and $0.11 per 1,000 ads

Scraping the Meta Ad Library in 2026: cursors, one-shot browsers, and $0.11 per 1,000 ads

1
Comments 4
3 min read
Why crawler reliability lives outside the scraper

Why crawler reliability lives outside the scraper

Comments
9 min read
CĂłmo solucionar el error \"Enable JavaScript and cookies to continue\"

CĂłmo solucionar el error \"Enable JavaScript and cookies to continue\"

Comments
3 min read
I scraped 100 Brazilian tech job listings to measure what companies actually pay

I scraped 100 Brazilian tech job listings to measure what companies actually pay

Comments
4 min read
If Claude and Codex Can Scrape the Web, Why Do We Still Need Web Scraping Tools?

If Claude and Codex Can Scrape the Web, Why Do We Still Need Web Scraping Tools?

1
Comments 11
1 min read
Competitive Intelligence Is a Freshness Problem, Not a Dashboard Problem

Competitive Intelligence Is a Freshness Problem, Not a Dashboard Problem

Comments
4 min read
Getting Google Flights prices into a spreadsheet

Getting Google Flights prices into a spreadsheet

1
Comments 1
3 min read
Meetup Events Scraper: the search page ships its whole Apollo cache, and that is the API

Meetup Events Scraper: the search page ships its whole Apollo cache, and that is the API

Comments 2
4 min read
Greenfinger 2.0: One url in, a searchable archive out

Greenfinger 2.0: One url in, a searchable archive out

Comments
10 min read
Google Play and App Store reviews in one table, with one API call

Google Play and App Store reviews in one table, with one API call

Comments
4 min read
Lessons Learned: Dealing With Instagram Rate Limits and Blocks

Lessons Learned: Dealing With Instagram Rate Limits and Blocks

Comments
4 min read
Coles, Woolworths and Aldi prices in one schema: what a weekly snapshot actually captures

Coles, Woolworths and Aldi prices in one schema: what a weekly snapshot actually captures

Comments 2
5 min read
Reverse Engineering YouTube's Web API: Why I Ditched Selenium and the Official Data API

Reverse Engineering YouTube's Web API: Why I Ditched Selenium and the Official Data API

2
Comments 2
2 min read
Every open job for a list of companies, in one table (Workday, Greenhouse, Lever and 14 more)

Every open job for a list of companies, in one table (Workday, Greenhouse, Lever and 14 more)

Comments
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.