DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Building Instagram Data Workflows with HikerAPI (Without Maintaining Scrapers)

Building Instagram Data Workflows with HikerAPI (Without Maintaining Scrapers)

Comments
3 min read
Choosing the Right Scraping Interface for LLM Workflows

Choosing the Right Scraping Interface for LLM Workflows

1
Comments
4 min read
USPTO Patent Search API: scrape US patents to clean JSON for $3/1K

USPTO Patent Search API: scrape US patents to clean JSON for $3/1K

1
Comments
7 min read
How I Built a Google Shopping Scraper with Python & Playwright

How I Built a Google Shopping Scraper with Python & Playwright

Comments
1 min read
How to scrape Nextdoor for hyper-local demographics and community sentiment

How to scrape Nextdoor for hyper-local demographics and community sentiment

5
Comments
9 min read
How China-focused funds turn Weibo into alt-data (Python, 2026)

How China-focused funds turn Weibo into alt-data (Python, 2026)

Comments
4 min read
Scraping Without Tests Is Gambling. And the House Always Wins.

Scraping Without Tests Is Gambling. And the House Always Wins.

1
Comments
3 min read
Anonymous Proxies: How Modern Websites Decide Whether to Trust Your Traffic

Anonymous Proxies: How Modern Websites Decide Whether to Trust Your Traffic

Comments
7 min read
We patched Chromium with 49 C++ hooks to beat Cloudflare — here's how BrowserHand works

We patched Chromium with 49 C++ hooks to beat Cloudflare — here's how BrowserHand works

Comments
1 min read
How to scrape Google Play data with Node.js (no API key needed)

How to scrape Google Play data with Node.js (no API key needed)

1
Comments
4 min read
How to scrape Shopify App Store data with Python (no API key needed)

How to scrape Shopify App Store data with Python (no API key needed)

Comments
4 min read
When AI Agents Should Stop Using Browsers for Web Data

When AI Agents Should Stop Using Browsers for Web Data

1
Comments 1
5 min read
What changed since the last scrape? A small change-detection layer (stdlib only)

What changed since the last scrape? A small change-detection layer (stdlib only)

Comments
3 min read
How to Extract Saudi Arabia Property Data Across Bayut.sa, Wasalt.sa, Aqar.fm and PropertyFinder.sa

How to Extract Saudi Arabia Property Data Across Bayut.sa, Wasalt.sa, Aqar.fm and PropertyFinder.sa

Comments
5 min read
How to Extract Dubai Used Car Listings Data from Gulf Marketplaces

How to Extract Dubai Used Car Listings Data from Gulf Marketplaces

Comments
5 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.