DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
How to Scrape Bluesky Data in 2026 (Posts, Profiles, and Search)

How to Scrape Bluesky Data in 2026 (Posts, Profiles, and Search)

Comments
2 min read
Cloudflare wasn't blocking our IP. It was blocking our browser.

Cloudflare wasn't blocking our IP. It was blocking our browser.

Comments
3 min read
How to Build a Crawl Budget That Keeps AI Agents Fast and Predictable

How to Build a Crawl Budget That Keeps AI Agents Fast and Predictable

Comments
4 min read
I got tired of "remote" meaning "remote, US only", so I counted 2,798 companies

I got tired of "remote" meaning "remote, US only", so I counted 2,798 companies

Comments
5 min read
Scrape Any Site in 20 Lines with Residential Proxies (Node.js & Python)

Scrape Any Site in 20 Lines with Residential Proxies (Node.js & Python)

2
Comments
3 min read
How to Scrape Ashby Job Listings (With Salary Ranges) to JSON

How to Scrape Ashby Job Listings (With Salary Ranges) to JSON

Comments
4 min read
Investor Database API: Filter 10,469 VC, Angel, and PE Firms as JSON in 2026

Investor Database API: Filter 10,469 VC, Angel, and PE Firms as JSON in 2026

Comments
5 min read
Why AI Browser Agents Survive Site Redesigns (and Scripts Don't)

Why AI Browser Agents Survive Site Redesigns (and Scripts Don't)

Comments
1 min read
Yandex Search API: How to Scrape Yandex SERPs as Structured JSON in 2026

Yandex Search API: How to Scrape Yandex SERPs as Structured JSON in 2026

Comments
5 min read
Playwright + Proxies: Sticky Sessions, Rotation, and the SOCKS5 Trap

Playwright + Proxies: Sticky Sessions, Rotation, and the SOCKS5 Trap

Comments
3 min read
Six ATS platforms publish their job boards as open JSON. Here are the endpoints.

Six ATS platforms publish their job boards as open JSON. Here are the endpoints.

Comments
7 min read
How to Scrape Airbnb Listings and Prices in 2026 (No Code Required)

How to Scrape Airbnb Listings and Prices in 2026 (No Code Required)

Comments
2 min read
Oxylabs Alternatives: When AI Workflows Need Browser Sessions, Not Just Proxies

Oxylabs Alternatives: When AI Workflows Need Browser Sessions, Not Just Proxies

Comments
5 min read
Scrape Eventbrite events without a headless browser

Scrape Eventbrite events without a headless browser

Comments
4 min read
I Was Spending 48 Hours Every Month Checking Supplier Prices. So I Built a Python Script to Do It for Me

I Was Spending 48 Hours Every Month Checking Supplier Prices. So I Built a Python Script to Do It for Me

Comments
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.