DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Anti bot protection

Anti bot protection

Comments
1 min read
How to Get Amazon Review & Rating Data at Scale (and What's Actually Public in 2026)

How to Get Amazon Review & Rating Data at Scale (and What's Actually Public in 2026)

2
Comments
3 min read
Your proxy connected. That doesn't mean it hid your IP.

Your proxy connected. That doesn't mean it hid your IP.

1
Comments
4 min read
I built a tool that checks whether ChatGPT recommends your brand (Python + Apify)

I built a tool that checks whether ChatGPT recommends your brand (Python + Apify)

2
Comments 1
7 min read
Why I only track one bookmaker for my odds-movement signal (and it's not the popular one)

Why I only track one bookmaker for my odds-movement signal (and it's not the popular one)

Comments
2 min read
Getting past Binance and Bybit's datacenter IP blocks without overpaying for proxies

Getting past Binance and Bybit's datacenter IP blocks without overpaying for proxies

Comments
2 min read
Expensive Discovery, Cheap Enrichment: A Marketplace Scraper Architecture Built Around Rate Limits

Expensive Discovery, Cheap Enrichment: A Marketplace Scraper Architecture Built Around Rate Limits

Comments
13 min read
The Wildberries API in English: How to Get Products, Prices and Reviews as JSON

The Wildberries API in English: How to Get Products, Prices and Reviews as JSON

1
Comments
13 min read
Fragrance notes, accords and ratings as JSON, without fighting Fragrantica's Cloudflare

Fragrance notes, accords and ratings as JSON, without fighting Fragrantica's Cloudflare

2
Comments
3 min read
Turn a watch reference number into full specs (caliber, case, dial) as JSON

Turn a watch reference number into full specs (caliber, case, dial) as JSON

1
Comments
3 min read
Your LLM can scrape the web — locally, without writing throwaway code

Your LLM can scrape the web — locally, without writing throwaway code

3
Comments 2
8 min read
What DIY web scraping really costs (2026 TCO breakdown)

What DIY web scraping really costs (2026 TCO breakdown)

Comments
7 min read
Building a Python-based Forex Scraper and MCP Server: Forex-Pytory

Building a Python-based Forex Scraper and MCP Server: Forex-Pytory

Comments
1 min read
Why Data Collection Systems Work for 10 Minutes and Fail After 10,000 Requests

Why Data Collection Systems Work for 10 Minutes and Fail After 10,000 Requests

Comments
6 min read
I added a new feature to a live paid actor — the data was already there, I just wasn't reading it

I added a new feature to a live paid actor — the data was already there, I just wasn't reading it

Comments
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.