DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
We tested 62,541 free proxies from GitHub. Only 4% actually work.

We tested 62,541 free proxies from GitHub. Only 4% actually work.

1
Comments
3 min read
How to Build a Market Research Agent with ZenRows and LangChain

How to Build a Market Research Agent with ZenRows and LangChain

21
Comments 1
7 min read
How to track Weibo hot-search velocity with Python in 2026 — the trending-delta problem and how to handle it

How to track Weibo hot-search velocity with Python in 2026 — the trending-delta problem and how to handle it

Comments
4 min read
Browser automation is not always the right layer for data extraction

Browser automation is not always the right layer for data extraction

Comments 1
4 min read
How to Scrape E-Commerce Sites for AI Agents Using Playwright and LLMs

How to Scrape E-Commerce Sites for AI Agents Using Playwright and LLMs

Comments
6 min read
Building a Rotating Proxy Pool in Python That Survives Failures

Building a Rotating Proxy Pool in Python That Survives Failures

Comments
3 min read
Your AI Agent Is Paying for HTML It Never Reads — I Measured the 7x Token Tax

Your AI Agent Is Paying for HTML It Never Reads — I Measured the 7x Token Tax

Comments
5 min read
What is Web Scraping? A Beginner's Guide with Real Python Code

What is Web Scraping? A Beginner's Guide with Real Python Code

2
Comments
2 min read
Amazon Seller Competitor Research Methods: A Developer's Guide with Code

Amazon Seller Competitor Research Methods: A Developer's Guide with Code

7
Comments
8 min read
Your scraper says 200 OK. I measured how often it's lying.

Your scraper says 200 OK. I measured how often it's lying.

1
Comments
7 min read
I shipped 10 paid data scrapers in one week: what actually worked (and what quietly lost money)

I shipped 10 paid data scrapers in one week: what actually worked (and what quietly lost money)

Comments
3 min read
How Scraping API Pricing Changes Once You Need Browser Sessions

How Scraping API Pricing Changes Once You Need Browser Sessions

Comments
3 min read
When a Site Blocks Your Scraper, Read the Browser Tab You Already Have Open

When a Site Blocks Your Scraper, Read the Browser Tab You Already Have Open

Comments
6 min read
How to Get Google Search Results in JSON for an AI Agent

How to Get Google Search Results in JSON for an AI Agent

3
Comments
6 min read
Build vs buy: what running your own CAPTCHA-solving stack actually costs

Build vs buy: what running your own CAPTCHA-solving stack actually costs

Comments
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.