DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Why Proxy Workflows Need Session Boundaries Before Retry Logic
conal_garrett_9ec4e0517ed profile

Why Proxy Workflows Need Session Boundaries Before Retry Logic

#proxy #webscraping #testing #api
Comments
4 min read
How to Scrape Bluesky Data in 2026 (Posts, Profiles, and Search)
ethan_teague profile

How to Scrape Bluesky Data in 2026 (Posts, Profiles, and Search)

#webscraping #api #python #socialmedia
Comments
2 min read
Cloudflare wasn't blocking our IP. It was blocking our browser.
deadlockv2 profile

Cloudflare wasn't blocking our IP. It was blocking our browser.

#webdev #cloudflarechallenge #webscraping #devops
Comments
3 min read
Workday job boards have a JSON API too. It's just better hidden.
udaninn profile

Workday job boards have a JSON API too. It's just better hidden.

#api #python #webscraping #hiring
Comments
5 min read
How to Build a Crawl Budget That Keeps AI Agents Fast and Predictable
kun_shen_eedb57cc827955f5 profile

How to Build a Crawl Budget That Keeps AI Agents Fast and Predictable

#agents #ai #performance #webscraping
Comments
4 min read
I got tired of "remote" meaning "remote, US only", so I counted 2,798 companies
elon_zuckerman_bc59ff99f3 profile

I got tired of "remote" meaning "remote, US only", so I counted 2,798 companies

#remote #webscraping #career #data
Comments
5 min read
Scrape Any Site in 20 Lines with Residential Proxies (Node.js & Python)
aethyn_team profile

Scrape Any Site in 20 Lines with Residential Proxies (Node.js & Python)

#node #python #tutorial #webscraping
2
Comments
3 min read
How to Scrape Ashby Job Listings (With Salary Ranges) to JSON
ratiotech profile

How to Scrape Ashby Job Listings (With Salary Ranges) to JSON

#webscraping #python #api #career
Comments
4 min read
Investor Database API: Filter 10,469 VC, Angel, and PE Firms as JSON in 2026
trufflepig profile

Investor Database API: Filter 10,469 VC, Angel, and PE Firms as JSON in 2026

#webscraping #python #api #fintech
Comments
5 min read
Why AI Browser Agents Survive Site Redesigns (and Scripts Don't)
paulcrinigan profile

Why AI Browser Agents Survive Site Redesigns (and Scripts Don't)

#ai #automation #webscraping #webdev
Comments
1 min read
Yandex Search API: How to Scrape Yandex SERPs as Structured JSON in 2026
trufflepig profile

Yandex Search API: How to Scrape Yandex SERPs as Structured JSON in 2026

#webscraping #python #api #seo
Comments
5 min read
Six ATS platforms publish their job boards as open JSON. Here are the endpoints.
udaninn profile

Six ATS platforms publish their job boards as open JSON. Here are the endpoints.

#api #python #webscraping #hiring
Comments
7 min read
Playwright + Proxies: Sticky Sessions, Rotation, and the SOCKS5 Trap
roamproxy profile

Playwright + Proxies: Sticky Sessions, Rotation, and the SOCKS5 Trap

#webscraping #playwright #python #tutorial
Comments
3 min read
How to Scrape Airbnb Listings and Prices in 2026 (No Code Required)
ethan_teague profile

How to Scrape Airbnb Listings and Prices in 2026 (No Code Required)

#webscraping #api #datascience #python
Comments
2 min read
Oxylabs Alternatives: When AI Workflows Need Browser Sessions, Not Just Proxies
anakin_writers profile

Oxylabs Alternatives: When AI Workflows Need Browser Sessions, Not Just Proxies

#webscraping #playwright #api #ai
Comments
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.