DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
AI agents don't always need browsers to read the web

AI agents don't always need browsers to read the web

Comments
4 min read
[BA-006] Extracting structured data with browser automation

[BA-006] Extracting structured data with browser automation

Comments 1
2 min read
[BA-005] Stealth and anti-detection for browser automation

[BA-005] Stealth and anti-detection for browser automation

Comments 1
2 min read
Reverb Scraper: pull historical sold prices for any musical gear

Reverb Scraper: pull historical sold prices for any musical gear

Comments
7 min read
LLM API pricing comparison: one schema across all 7 providers for $5.05/1K

LLM API pricing comparison: one schema across all 7 providers for $5.05/1K

Comments
8 min read
How to scrape Apple App Store data with Python (no API key needed)

How to scrape Apple App Store data with Python (no API key needed)

Comments
4 min read
Lemmy Scraper: export posts and comments from any Fediverse community

Lemmy Scraper: export posts and comments from any Fediverse community

1
Comments
9 min read
3 Reasons Your Web Scraper Breaks in Production (and How to Fix Each)

3 Reasons Your Web Scraper Breaks in Production (and How to Fix Each)

Comments
2 min read
Kick Chat Scraper: archive live chat before it disappears forever

Kick Chat Scraper: archive live chat before it disappears forever

Comments
7 min read
IRS 990 Scraper: pull nonprofit officer comp + financials for $3.05/1K

IRS 990 Scraper: pull nonprofit officer comp + financials for $3.05/1K

Comments
8 min read
Spoofing Your Scraper's Fingerprint Is a Losing Arcade

Spoofing Your Scraper's Fingerprint Is a Losing Arcade

Comments
9 min read
Stop pretending your scraper worked: honest JSON for AI agents

Stop pretending your scraper worked: honest JSON for AI agents

1
Comments
4 min read
Lessons Learned: Dealing With Instagram Rate Limits and Blocks (and Why I Switched to a Hosted API)

Lessons Learned: Dealing With Instagram Rate Limits and Blocks (and Why I Switched to a Hosted API)

1
Comments
2 min read
Your Scraper Returned a Clean Row. It Was Wrong.

Your Scraper Returned a Clean Row. It Was Wrong.

Comments
10 min read
The compiler caught a lot. It didn't catch enough.

The compiler caught a lot. It didn't catch enough.

Comments
8 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.