DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Benchmark a product category on Alibaba before you source it (Python, real numbers)

Benchmark a product category on Alibaba before you source it (Python, real numbers)

Comments
3 min read
What a PSA 10 Charizard costs on Whatnot, from 73 live listings

What a PSA 10 Charizard costs on Whatnot, from 73 live listings

Comments
3 min read
How I Built a Web Scraper That Doesn’t Break in Production

How I Built a Web Scraper That Doesn’t Break in Production

14
Comments 6
11 min read
pytrends is archived: fixing Google Trends 429 errors in 2026

pytrends is archived: fixing Google Trends 429 errors in 2026

Comments
3 min read
We benchmarked 4 web scraping APIs for AI agents against DataDome, Cloudflare, and Akamai

We benchmarked 4 web scraping APIs for AI agents against DataDome, Cloudflare, and Akamai

1
Comments 1
11 min read
Scraping websites and bot-protection

Scraping websites and bot-protection

6
Comments 1
9 min read
Residential Proxies Made My Lazada Scraper Worse: the Gate Reads the Handshake, Not the IP

Residential Proxies Made My Lazada Scraper Worse: the Gate Reads the Handshake, Not the IP

Comments
7 min read
Google Hotels API: hotel prices by date as JSON

Google Hotels API: hotel prices by date as JSON

5
Comments 1
3 min read
How to export Google Play reviews to CSV for any app and country

How to export Google Play reviews to CSV for any app and country

Comments
3 min read
How to bulk-audit local business websites

How to bulk-audit local business websites

Comments
6 min read
How to get Google Hotels prices for any dates with Python (and see which booking site is cheapest)

How to get Google Hotels prices for any dates with Python (and see which booking site is cheapest)

Comments
5 min read
Ask Threads for 50 Replies and Half of What Comes Back Is Other People's Posts

Ask Threads for 50 Replies and Half of What Comes Back Is Other People's Posts

Comments
6 min read
Your Scraper's "Success" Metric Is Lying When the Site Sends You an Empty 200

Your Scraper's "Success" Metric Is Lying When the Site Sends You an Empty 200

Comments 2
3 min read
7 tricks and 3 traps from scraping Twitch, YouTube, TikTok, Kick, Bluesky and Patreon with no login and no browser

7 tricks and 3 traps from scraping Twitch, YouTube, TikTok, Kick, Bluesky and Patreon with no login and no browser

Comments
3 min read
A Threads Search Result Is a Thread, Not a Post

A Threads Search Result Is a Thread, Not a Post

Comments
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.