DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Kick Chat Scraper: archive live chat before it disappears forever

Kick Chat Scraper: archive live chat before it disappears forever

Comments
7 min read
IRS 990 Scraper: pull nonprofit officer comp + financials for $3.05/1K

IRS 990 Scraper: pull nonprofit officer comp + financials for $3.05/1K

Comments
8 min read
Spoofing Your Scraper's Fingerprint Is a Losing Arcade

Spoofing Your Scraper's Fingerprint Is a Losing Arcade

Comments
9 min read
Stop pretending your scraper worked: honest JSON for AI agents

Stop pretending your scraper worked: honest JSON for AI agents

1
Comments
4 min read
Lessons Learned: Dealing With Instagram Rate Limits and Blocks (and Why I Switched to a Hosted API)

Lessons Learned: Dealing With Instagram Rate Limits and Blocks (and Why I Switched to a Hosted API)

1
Comments
2 min read
Your Scraper Returned a Clean Row. It Was Wrong.

Your Scraper Returned a Clean Row. It Was Wrong.

Comments
10 min read
The compiler caught a lot. It didn't catch enough.

The compiler caught a lot. It didn't catch enough.

Comments
8 min read
Why Your Scraper Works in the Browser But Fails in Python

Why Your Scraper Works in the Browser But Fails in Python

Comments
7 min read
Scraping Paginated Sites Without Getting It Wrong

Scraping Paginated Sites Without Getting It Wrong

Comments
6 min read
How to Handle JavaScript-Rendered Pages Without a Full Browser

How to Handle JavaScript-Rendered Pages Without a Full Browser

Comments
5 min read
How to Store What You Scrape (Without Making a Mess)

How to Store What You Scrape (Without Making a Mess)

Comments
5 min read
How to Scrape RedNote (Xiaohongshu) Without Coding

How to Scrape RedNote (Xiaohongshu) Without Coding

Comments
4 min read
How to monitor a brand across 5 Chinese social platforms with Python in 2026 — the cross-platform dedup problem and how to handle it

How to monitor a brand across 5 Chinese social platforms with Python in 2026 — the cross-platform dedup problem and how to handle it

Comments
4 min read
Bing Search API Replacement: scrape SERP results for $1.05/1K

Bing Search API Replacement: scrape SERP results for $1.05/1K

Comments
7 min read
Google AI Overview Tracker: 8-selector battery + citation drift telemetry

Google AI Overview Tracker: 8-selector battery + citation drift telemetry

Comments
8 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.