DEV Community

# webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Choosing the Right Scraping Interface for LLM Workflows

Choosing the Right Scraping Interface for LLM Workflows

1
Comments
4 min read
USPTO Patent Search API: scrape US patents to clean JSON for $3/1K

USPTO Patent Search API: scrape US patents to clean JSON for $3/1K

1
Comments
7 min read
The 7 Best Reddit Scrapers in 2026 (Free & Paid, Tested)

The 7 Best Reddit Scrapers in 2026 (Free & Paid, Tested)

Comments
5 min read
How I Built a Google Shopping Scraper with Python & Playwright

How I Built a Google Shopping Scraper with Python & Playwright

Comments
1 min read
How to scrape Nextdoor for hyper-local demographics and community sentiment

How to scrape Nextdoor for hyper-local demographics and community sentiment

5
Comments
9 min read
How China-focused funds turn Weibo into alt-data (Python, 2026)

How China-focused funds turn Weibo into alt-data (Python, 2026)

Comments
4 min read
Scraping Without Tests Is Gambling. And the House Always Wins.

Scraping Without Tests Is Gambling. And the House Always Wins.

1
Comments
3 min read
Anonymous Proxies: How Modern Websites Decide Whether to Trust Your Traffic

Anonymous Proxies: How Modern Websites Decide Whether to Trust Your Traffic

Comments
7 min read
We patched Chromium with 49 C++ hooks to beat Cloudflare — here's how BrowserHand works

We patched Chromium with 49 C++ hooks to beat Cloudflare — here's how BrowserHand works

Comments
1 min read
How to scrape Google Play data with Node.js (no API key needed)

How to scrape Google Play data with Node.js (no API key needed)

1
Comments
4 min read
How to scrape Redfin (US real estate) data with Node.js (no API key needed)

How to scrape Redfin (US real estate) data with Node.js (no API key needed)

Comments
4 min read
How to scrape Shopify App Store data with Python (no API key needed)

How to scrape Shopify App Store data with Python (no API key needed)

Comments
4 min read
When AI Agents Should Stop Using Browsers for Web Data

When AI Agents Should Stop Using Browsers for Web Data

1
Comments 1
5 min read
Building a self-hosted browser scraping service (is it more hassle than its worth?)

Building a self-hosted browser scraping service (is it more hassle than its worth?)

Comments
8 min read
Optimizing Browser Fingerprint Spoofing and Session Validation in Automated Scrapers

Optimizing Browser Fingerprint Spoofing and Session Validation in Automated Scrapers

1
Comments
2 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.