DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
How to Scrape Single-Page Apps (SPAs) with Playwright in 2026

How to Scrape Single-Page Apps (SPAs) with Playwright in 2026

1
Comments 1
5 min read
The Economics of Residential Proxies: How a "Free" Flashlight App Becomes a $10/GB Node

The Economics of Residential Proxies: How a "Free" Flashlight App Becomes a $10/GB Node

3
Comments 9
3 min read
Build a Price Tracker with Playwright: Monitor Amazon, BestBuy, and Any Retailer

Build a Price Tracker with Playwright: Monitor Amazon, BestBuy, and Any Retailer

1
Comments 2
3 min read
3 Free Apify Actors for Scraping Bluesky, Substack, and Hacker News (No API Keys Needed)

3 Free Apify Actors for Scraping Bluesky, Substack, and Hacker News (No API Keys Needed)

Comments
3 min read
How to Scrape Bluesky Posts and Profiles at Scale (No API Key Needed)

How to Scrape Bluesky Posts and Profiles at Scale (No API Key Needed)

2
Comments
3 min read
I built a Claude Code skill that screenshots any website (and it handles anti-bot sites too)

I built a Claude Code skill that screenshots any website (and it handles anti-bot sites too)

10
Comments 1
5 min read
WBW: A Telegram bot that watches web pages for you

WBW: A Telegram bot that watches web pages for you

1
Comments
2 min read
How I built a Mobile Price Tracker (Salert) using Bubble.io and Node.js Microservices

How I built a Mobile Price Tracker (Salert) using Bubble.io and Node.js Microservices

Comments 1
1 min read
Best Web Scraping Tools in 2026: I Tested 30+ Tools, and These Are the Only Ones Worth Using

Best Web Scraping Tools in 2026: I Tested 30+ Tools, and These Are the Only Ones Worth Using

19
Comments 1
11 min read
Why your Python request gets 403 Forbidden

Why your Python request gets 403 Forbidden

3
Comments
4 min read
Mitigating 'Scraping Shock': Engineering Cost-Aware Data Pipelines

Mitigating 'Scraping Shock': Engineering Cost-Aware Data Pipelines

Comments
5 min read
Boring Automation That Wins

Boring Automation That Wins

Comments 1
3 min read
Privacy Engineering: Automated PII Detection and Redaction

Privacy Engineering: Automated PII Detection and Redaction

Comments
15 min read
The Hybrid Fallback Strategy: Combining Cheerio and Playwright for Maximum Reliability

The Hybrid Fallback Strategy: Combining Cheerio and Playwright for Maximum Reliability

Comments
4 min read
Observability: Monitoring Spiders with Prometheus and Grafana

Observability: Monitoring Spiders with Prometheus and Grafana

Comments
12 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.