DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
How to Build a Crawl Budget That Keeps AI Agents Fast and Predictable

How to Build a Crawl Budget That Keeps AI Agents Fast and Predictable

Comments
4 min read
I got tired of "remote" meaning "remote, US only", so I counted 2,798 companies

I got tired of "remote" meaning "remote, US only", so I counted 2,798 companies

Comments
5 min read
Scrape Any Site in 20 Lines with Residential Proxies (Node.js & Python)

Scrape Any Site in 20 Lines with Residential Proxies (Node.js & Python)

2
Comments
3 min read
How to Scrape Ashby Job Listings (With Salary Ranges) to JSON

How to Scrape Ashby Job Listings (With Salary Ranges) to JSON

Comments
4 min read
Investor Database API: Filter 10,469 VC, Angel, and PE Firms as JSON in 2026

Investor Database API: Filter 10,469 VC, Angel, and PE Firms as JSON in 2026

Comments
5 min read
Why AI Browser Agents Survive Site Redesigns (and Scripts Don't)

Why AI Browser Agents Survive Site Redesigns (and Scripts Don't)

Comments
1 min read
Yandex Search API: How to Scrape Yandex SERPs as Structured JSON in 2026

Yandex Search API: How to Scrape Yandex SERPs as Structured JSON in 2026

Comments
5 min read
Job Postings Are the Most Underused B2B Intent Signal (And You Don't Even Need to Scrape)

Job Postings Are the Most Underused B2B Intent Signal (And You Don't Even Need to Scrape)

1
Comments 1
4 min read
How to Scrape Airbnb Listings and Prices in 2026 (No Code Required)

How to Scrape Airbnb Listings and Prices in 2026 (No Code Required)

Comments
2 min read
Oxylabs Alternatives: When AI Workflows Need Browser Sessions, Not Just Proxies

Oxylabs Alternatives: When AI Workflows Need Browser Sessions, Not Just Proxies

Comments
5 min read
Scrape Eventbrite events without a headless browser

Scrape Eventbrite events without a headless browser

Comments
4 min read
I Was Spending 48 Hours Every Month Checking Supplier Prices. So I Built a Python Script to Do It for Me

I Was Spending 48 Hours Every Month Checking Supplier Prices. So I Built a Python Script to Do It for Me

Comments
5 min read
EffatĂ : Chronicle of a Human-AI Collaboration for a Different Kind of Search Engine by DeepSeek, AI assistant

EffatĂ : Chronicle of a Human-AI Collaboration for a Different Kind of Search Engine by DeepSeek, AI assistant

Comments
7 min read
Building a Change & Alert Engine That Webhooks Any Diff on Any URL

Building a Change & Alert Engine That Webhooks Any Diff on Any URL

Comments
5 min read
Google Trends 429s your first request. The fix is 106 bytes.

Google Trends 429s your first request. The fix is 106 bytes.

1
Comments
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.