DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Why I only track one bookmaker for my odds-movement signal (and it's not the popular one)

Why I only track one bookmaker for my odds-movement signal (and it's not the popular one)

Comments
2 min read
Getting past Binance and Bybit's datacenter IP blocks without overpaying for proxies

Getting past Binance and Bybit's datacenter IP blocks without overpaying for proxies

Comments
2 min read
Expensive Discovery, Cheap Enrichment: A Marketplace Scraper Architecture Built Around Rate Limits

Expensive Discovery, Cheap Enrichment: A Marketplace Scraper Architecture Built Around Rate Limits

Comments
13 min read
The Wildberries API in English: How to Get Products, Prices and Reviews as JSON

The Wildberries API in English: How to Get Products, Prices and Reviews as JSON

1
Comments
13 min read
Fragrance notes, accords and ratings as JSON, without fighting Fragrantica's Cloudflare

Fragrance notes, accords and ratings as JSON, without fighting Fragrantica's Cloudflare

2
Comments
3 min read
Turn a watch reference number into full specs (caliber, case, dial) as JSON

Turn a watch reference number into full specs (caliber, case, dial) as JSON

1
Comments
3 min read
Your LLM can scrape the web — locally, without writing throwaway code

Your LLM can scrape the web — locally, without writing throwaway code

3
Comments 2
8 min read
What DIY web scraping really costs (2026 TCO breakdown)

What DIY web scraping really costs (2026 TCO breakdown)

Comments
7 min read
Building a Python-based Forex Scraper and MCP Server: Forex-Pytory

Building a Python-based Forex Scraper and MCP Server: Forex-Pytory

Comments
1 min read
Why Data Collection Systems Work for 10 Minutes and Fail After 10,000 Requests

Why Data Collection Systems Work for 10 Minutes and Fail After 10,000 Requests

Comments
6 min read
I added a new feature to a live paid actor — the data was already there, I just wasn't reading it

I added a new feature to a live paid actor — the data was already there, I just wasn't reading it

Comments
2 min read
Best Python Libraries for Web Scraping Without Getting Blocked in 2026

Best Python Libraries for Web Scraping Without Getting Blocked in 2026

Comments
7 min read
Choosing Between Scraping APIs, Browser Sessions, and Self-Managed Playwright

Choosing Between Scraping APIs, Browser Sessions, and Self-Managed Playwright

Comments
5 min read
Building a Resilient Meta Ads Scraper: What Breaks (and What I Learned Fixing It)

Building a Resilient Meta Ads Scraper: What Breaks (and What I Learned Fixing It)

Comments
4 min read
Google Trends will 429 you into the ground — here's how I got past it

Google Trends will 429 you into the ground — here's how I got past it

4
Comments 3
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.