DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Three small API-backed actors I've shipped recently (Docker Hub, lead extraction, SEC Form 4)

Three small API-backed actors I've shipped recently (Docker Hub, lead extraction, SEC Form 4)

1
Comments 1
2 min read
Bypassing Cloudflare Turnstile from Python without driving a browser

Bypassing Cloudflare Turnstile from Python without driving a browser

Comments
4 min read
What CAPTCHA solving actually costs (the line items nobody prints)

What CAPTCHA solving actually costs (the line items nobody prints)

Comments
3 min read
Why your scraper gets a 403 on Cloudflare Turnstile (and the token-injection fix)

Why your scraper gets a 403 on Cloudflare Turnstile (and the token-injection fix)

Comments
4 min read
Rotating Proxies with Python Requests: A Copy-Paste Starter Kit

Rotating Proxies with Python Requests: A Copy-Paste Starter Kit

Comments
4 min read
A finished scraper sat on a git branch for 19 days. Nothing noticed.

A finished scraper sat on a git branch for 19 days. Nothing noticed.

Comments
5 min read
Designing AI agents that can use live web data

Designing AI agents that can use live web data

Comments 1
4 min read
Reverse-Engineering Glassdoor Estimated Job Posting Dates in Python

Reverse-Engineering Glassdoor Estimated Job Posting Dates in Python

Comments 1
2 min read
The Same Seat, Three Prices: Reading Google Flights Booking Options in Python

The Same Seat, Three Prices: Reading Google Flights Booking Options in Python

Comments
3 min read
Three Playwright/Apify bugs that took me way too long to find (and the fixes)

Three Playwright/Apify bugs that took me way too long to find (and the fixes)

Comments
4 min read
Scraping 150k+ Instagram followers reliably: batching, resume-on-error, and enrichment

Scraping 150k+ Instagram followers reliably: batching, resume-on-error, and enrichment

Comments
2 min read
How to find every Shopify store in a list of 10,000 domains

How to find every Shopify store in a list of 10,000 domains

Comments
3 min read
Tennis, football and basketball results as clean JSON, without a sports data contract

Tennis, football and basketball results as clean JSON, without a sports data contract

Comments
4 min read
Remote Job Aggregators on Apify Compared (September 2026)

Remote Job Aggregators on Apify Compared (September 2026)

Comments
6 min read
"A Raw JSON Textarea Was Quietly Costing Me Users"

"A Raw JSON Textarea Was Quietly Costing Me Users"

1
Comments 4
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.