DEV Community

# webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
We Ran 15,000 Browser Automations. The Failure That Matters Most Is Invisible to Your Monitoring.

We Ran 15,000 Browser Automations. The Failure That Matters Most Is Invisible to Your Monitoring.

Comments
5 min read
I built MCP Sub-50ms fetches for protected websites

I built MCP Sub-50ms fetches for protected websites

2
Comments
2 min read
I built two Apify actors that scrape U.S. Congress trading data — directly from government sources, no QuiverQuant

I built two Apify actors that scrape U.S. Congress trading data — directly from government sources, no QuiverQuant

Comments
7 min read
Stop Getting Blocked: Recon Your Target Website Before Scraping It

Stop Getting Blocked: Recon Your Target Website Before Scraping It

Comments
1 min read
Weekend Project: Build a ₹0 Amazon India Price Tracker in 50 Lines of Python

Weekend Project: Build a ₹0 Amazon India Price Tracker in 50 Lines of Python

7
Comments
4 min read
How to scrape Weibo (微博) data with Python in 2026 — the Sina Visitor System and how to handle it

How to scrape Weibo (微博) data with Python in 2026 — the Sina Visitor System and how to handle it

Comments 1
5 min read
When Should Developers Use a SERP API Instead of Scraping Google Directly?

When Should Developers Use a SERP API Instead of Scraping Google Directly?

Comments
2 min read
Bilibili API Alternative: Scrape Videos & Creators in 30 Lines of Python (No Browser, No Proxy)

Bilibili API Alternative: Scrape Videos & Creators in 30 Lines of Python (No Browser, No Proxy)

Comments
4 min read
Best Vinted Scraper in 2026 — Honest Tools Comparison

Best Vinted Scraper in 2026 — Honest Tools Comparison

Comments 1
7 min read
Scraping JavaScript-Heavy SPAs with Python: Dynamic Content, Infinite Scroll, and API Interception

Scraping JavaScript-Heavy SPAs with Python: Dynamic Content, Infinite Scroll, and API Interception

Comments
7 min read
Stop Buying Proxy Lists: Scive Real-Time Proxies with Node.js

Stop Buying Proxy Lists: Scive Real-Time Proxies with Node.js

Comments 2
2 min read
What Is Web Scraping? How It Works in 2026

What Is Web Scraping? How It Works in 2026

Comments
13 min read
I Built Skills That Let AI Agents Query 14 European Government Registries

I Built Skills That Let AI Agents Query 14 European Government Registries

Comments
7 min read
Why Your Web Scraper Works Today but Fails Tomorrow

Why Your Web Scraper Works Today but Fails Tomorrow

Comments
4 min read
Robust LLM Extractor for Websites in TypeScript!

Robust LLM Extractor for Websites in TypeScript!

Comments
12 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.