DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
What CAPTCHA solving actually costs (the line items nobody prints)

What CAPTCHA solving actually costs (the line items nobody prints)

Comments
3 min read
Bypassing Cloudflare Turnstile from Python without driving a browser

Bypassing Cloudflare Turnstile from Python without driving a browser

Comments
4 min read
Why your scraper gets a 403 on Cloudflare Turnstile (and the token-injection fix)

Why your scraper gets a 403 on Cloudflare Turnstile (and the token-injection fix)

Comments
4 min read
Rotating Proxies with Python Requests: A Copy-Paste Starter Kit

Rotating Proxies with Python Requests: A Copy-Paste Starter Kit

Comments
4 min read
A finished scraper sat on a git branch for 19 days. Nothing noticed.

A finished scraper sat on a git branch for 19 days. Nothing noticed.

Comments
5 min read
Designing AI agents that can use live web data

Designing AI agents that can use live web data

Comments 1
4 min read
Reverse-Engineering Glassdoor Estimated Job Posting Dates in Python

Reverse-Engineering Glassdoor Estimated Job Posting Dates in Python

Comments 1
2 min read
The Same Seat, Three Prices: Reading Google Flights Booking Options in Python

The Same Seat, Three Prices: Reading Google Flights Booking Options in Python

Comments
3 min read
Three Playwright/Apify bugs that took me way too long to find (and the fixes)

Three Playwright/Apify bugs that took me way too long to find (and the fixes)

Comments
4 min read
Scraping 150k+ Instagram followers reliably: batching, resume-on-error, and enrichment

Scraping 150k+ Instagram followers reliably: batching, resume-on-error, and enrichment

Comments
2 min read
Tennis, football and basketball results as clean JSON, without a sports data contract

Tennis, football and basketball results as clean JSON, without a sports data contract

Comments
4 min read
How to find every Shopify store in a list of 10,000 domains

How to find every Shopify store in a list of 10,000 domains

Comments
3 min read
Remote Job Aggregators on Apify Compared (September 2026)

Remote Job Aggregators on Apify Compared (September 2026)

Comments
6 min read
"A Raw JSON Textarea Was Quietly Costing Me Users"

"A Raw JSON Textarea Was Quietly Costing Me Users"

1
Comments 4
2 min read
Headless browsers vs. SERP APIs: Why your Playwright scraper fails in production

Headless browsers vs. SERP APIs: Why your Playwright scraper fails in production

5
Comments
15 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.