DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Practical Web Scraping in Python: Playwright, Scrapy, and Where They Meet

Practical Web Scraping in Python: Playwright, Scrapy, and Where They Meet

Comments 2
3 min read
How I killed my fragile Instagram scraper and collapsed data collection into one API call

How I killed my fragile Instagram scraper and collapsed data collection into one API call

Comments
1 min read
From Crawler Chaos to Official API: How We Rebuilt Our Cross-Border E-Commerce Backend

From Crawler Chaos to Official API: How We Rebuilt Our Cross-Border E-Commerce Backend

Comments
2 min read
WAFER Deep Crawler: 8-Layer Stealth Architecture - Fingerprint Layer

WAFER Deep Crawler: 8-Layer Stealth Architecture - Fingerprint Layer

5
Comments
3 min read
Heroku Is Getting Expensive: A 2026 Cost Calculator + Migration Guide

Heroku Is Getting Expensive: A 2026 Cost Calculator + Migration Guide

1
Comments 1
13 min read
How to Collect Product Data from a Website with Python

How to Collect Product Data from a Website with Python

1
Comments
3 min read
I Built a Tool to Track Which World Cup Players Are Blowing Up on Social Media

I Built a Tool to Track Which World Cup Players Are Blowing Up on Social Media

1
Comments
3 min read
5 lessons from 5 interviews on AI agents and web scraping

5 lessons from 5 interviews on AI agents and web scraping

Comments 2
5 min read
Anti bot protection

Anti bot protection

Comments
1 min read
How to Get Amazon Review & Rating Data at Scale (and What's Actually Public in 2026)

How to Get Amazon Review & Rating Data at Scale (and What's Actually Public in 2026)

2
Comments
3 min read
I built a tool that checks whether ChatGPT recommends your brand (Python + Apify)

I built a tool that checks whether ChatGPT recommends your brand (Python + Apify)

2
Comments 1
7 min read
Why I only track one bookmaker for my odds-movement signal (and it's not the popular one)

Why I only track one bookmaker for my odds-movement signal (and it's not the popular one)

Comments
2 min read
Getting past Binance and Bybit's datacenter IP blocks without overpaying for proxies

Getting past Binance and Bybit's datacenter IP blocks without overpaying for proxies

Comments
2 min read
Expensive Discovery, Cheap Enrichment: A Marketplace Scraper Architecture Built Around Rate Limits

Expensive Discovery, Cheap Enrichment: A Marketplace Scraper Architecture Built Around Rate Limits

Comments
13 min read
The Wildberries API in English: How to Get Products, Prices and Reviews as JSON

The Wildberries API in English: How to Get Products, Prices and Reviews as JSON

1
Comments
13 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.