DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Comparing the job-posting APIs of Workday, Greenhouse, Lever, Ashby, SmartRecruiters, and Recruitee (2026)

Comparing the job-posting APIs of Workday, Greenhouse, Lever, Ashby, SmartRecruiters, and Recruitee (2026)

2
Comments
4 min read
My Claude Code skills never auto-activated either — here's what we fixed

My Claude Code skills never auto-activated either — here's what we fixed

1
Comments
6 min read
Your scraper isn't blocked — your proxy is. Stop treating every failure the same way

Your scraper isn't blocked — your proxy is. Stop treating every failure the same way

5
Comments
8 min read
WHOIS Is Broken in 2026. Here's the RDAP-First Drop-In That Actually Returns JSON

WHOIS Is Broken in 2026. Here's the RDAP-First Drop-In That Actually Returns JSON

Comments
14 min read
Your scraper probably doesn't need a browser. It needs the right request.

Your scraper probably doesn't need a browser. It needs the right request.

Comments 1
3 min read
CDP Browser Control: Driving Real Chromium from Python

CDP Browser Control: Driving Real Chromium from Python

Comments
1 min read
Lead Enrichment Pipeline: From Domain to Full Company Profile (Free Stack)

Lead Enrichment Pipeline: From Domain to Full Company Profile (Free Stack)

Comments
11 min read
Scraping Sites That Block Bots: Cloudflare, DataDome & PerimeterX

Scraping Sites That Block Bots: Cloudflare, DataDome & PerimeterX

Comments
11 min read
Stop writing a parser per site. Run five and let confidence decide.

Stop writing a parser per site. Run five and let confidence decide.

8
Comments
3 min read
How to Evaluate a White-Label Proxy Infrastructure Provider: A Checklist for Resellers and SaaS Teams

How to Evaluate a White-Label Proxy Infrastructure Provider: A Checklist for Resellers and SaaS Teams

Comments
3 min read
The Facebook URL Zoo: every page-link format and how to canonicalize them

The Facebook URL Zoo: every page-link format and how to canonicalize them

2
Comments 3
4 min read
Your analytics dashboard is blind to most AI traffic. Here's how I fixed mine.

Your analytics dashboard is blind to most AI traffic. Here's how I fixed mine.

Comments
4 min read
Your Scraper Works Locally but Returns 403 on a Server. Here's Why.

Your Scraper Works Locally but Returns 403 on a Server. Here's Why.

Comments
11 min read
How to Scrape Any Shopify Store and Get Structured Product Data

How to Scrape Any Shopify Store and Get Structured Product Data

Comments
3 min read
The Real Alternative Data Edge Isn't the Data — It's the Pipeline

The Real Alternative Data Edge Isn't the Data — It's the Pipeline

Comments
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.