DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Found a gap in the bookkeeping automation chain

Found a gap in the bookkeeping automation chain

1
Comments 1
1 min read
Build a Healthcare Lead List From the Public NPI Registry (NPPES API)

Build a Healthcare Lead List From the Public NPI Registry (NPPES API)

Comments
3 min read
How We Optimized a Django Playwright Scraper to Save 60% on Rotating Proxy Bandwidth

How We Optimized a Django Playwright Scraper to Save 60% on Rotating Proxy Bandwidth

Comments
4 min read
How Paywalls Actually Work: The Engineering Behind Them

How Paywalls Actually Work: The Engineering Behind Them

2
Comments
14 min read
Why Cloudflare Breaks Proxy-Only Scrapers

Why Cloudflare Breaks Proxy-Only Scrapers

Comments
4 min read
Diagnosing Cloudflare Blocks Before Changing Your Scraper

Diagnosing Cloudflare Blocks Before Changing Your Scraper

2
Comments 2
4 min read
We tested 62,541 free proxies from GitHub. Only 4% actually work.

We tested 62,541 free proxies from GitHub. Only 4% actually work.

1
Comments
3 min read
How to Build a Market Research Agent with ZenRows and LangChain

How to Build a Market Research Agent with ZenRows and LangChain

20
Comments 1
7 min read
How to track Weibo hot-search velocity with Python in 2026 — the trending-delta problem and how to handle it

How to track Weibo hot-search velocity with Python in 2026 — the trending-delta problem and how to handle it

Comments
4 min read
How to Scrape E-Commerce Sites for AI Agents Using Playwright and LLMs

How to Scrape E-Commerce Sites for AI Agents Using Playwright and LLMs

Comments
6 min read
Your AI Agent Is Paying for HTML It Never Reads — I Measured the 7x Token Tax

Your AI Agent Is Paying for HTML It Never Reads — I Measured the 7x Token Tax

Comments
5 min read
What is Web Scraping? A Beginner's Guide with Real Python Code

What is Web Scraping? A Beginner's Guide with Real Python Code

2
Comments
2 min read
Amazon Seller Competitor Research Methods: A Developer's Guide with Code

Amazon Seller Competitor Research Methods: A Developer's Guide with Code

5
Comments
8 min read
I shipped 10 paid data scrapers in one week: what actually worked (and what quietly lost money)

I shipped 10 paid data scrapers in one week: what actually worked (and what quietly lost money)

Comments
3 min read
Your scraper says 200 OK. I measured how often it's lying.

Your scraper says 200 OK. I measured how often it's lying.

1
Comments
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.