DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
I built a tyre price comparison actor across multiple retailers - a bug where a page's own analytics code had cleaner data than its HTML

I built a tyre price comparison actor across multiple retailers - a bug where a page's own analytics code had cleaner data than its HTML

Comments 2
2 min read
I built a job search actor that aggregates 5 job boards - a $15/hour vs $50,000/year bug I found along the way

I built a job search actor that aggregates 5 job boards - a $15/hour vs $50,000/year bug I found along the way

Comments
2 min read
Is there an API for LinkedIn job postings? I pulled 90 real listings to check

Is there an API for LinkedIn job postings? I pulled 90 real listings to check

Comments 1
7 min read
How modern bot detection works in 2026 (behavior, fingerprinting, ML)

How modern bot detection works in 2026 (behavior, fingerprinting, ML)

Comments
6 min read
Why Scraper Maintenance Is Harder Than Writing the First Script

Why Scraper Maintenance Is Harder Than Writing the First Script

Comments
6 min read
I built a hiring-intent scanner for target companies' job boards - two free unauthenticated APIs I found along the way

I built a hiring-intent scanner for target companies' job boards - two free unauthenticated APIs I found along the way

Comments 2
2 min read
I built a lead scanner that watches the SEC's free real-time fundraising feed - here's what broke

I built a lead scanner that watches the SEC's free real-time fundraising feed - here's what broke

Comments
2 min read
Comparing the job-posting APIs of Workday, Greenhouse, Lever, Ashby, SmartRecruiters, and Recruitee (2026)

Comparing the job-posting APIs of Workday, Greenhouse, Lever, Ashby, SmartRecruiters, and Recruitee (2026)

2
Comments
4 min read
My Claude Code skills never auto-activated either — here's what we fixed

My Claude Code skills never auto-activated either — here's what we fixed

1
Comments
6 min read
Your scraper isn't blocked — your proxy is. Stop treating every failure the same way

Your scraper isn't blocked — your proxy is. Stop treating every failure the same way

5
Comments
8 min read
WHOIS Is Broken in 2026. Here's the RDAP-First Drop-In That Actually Returns JSON

WHOIS Is Broken in 2026. Here's the RDAP-First Drop-In That Actually Returns JSON

Comments
14 min read
Indeed 403s you with zero bytes. The companies it aggregates publish free APIs.

Indeed 403s you with zero bytes. The companies it aggregates publish free APIs.

Comments
6 min read
Your scraper probably doesn't need a browser. It needs the right request.

Your scraper probably doesn't need a browser. It needs the right request.

Comments 1
3 min read
CDP Browser Control: Driving Real Chromium from Python

CDP Browser Control: Driving Real Chromium from Python

Comments
1 min read
Lead Enrichment Pipeline: From Domain to Full Company Profile (Free Stack)

Lead Enrichment Pipeline: From Domain to Full Company Profile (Free Stack)

Comments
11 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.