DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
How I killed my fragile Instagram scraper and collapsed data collection into one API call
__b63e94d6ead profile

How I killed my fragile Instagram scraper and collapsed data collection into one API call

#api #automation #infrastructure #webscraping
Comments
1 min read
The real cost of solving reCAPTCHA at scale (per-1,000 vs thread-based)
bshahin profile

The real cost of solving reCAPTCHA at scale (per-1,000 vs thread-based)

#webscraping #python #automation #captcha
Comments
3 min read
From Crawler Chaos to Official API: How We Rebuilt Our Cross-Border E-Commerce Backend
taocarts profile

From Crawler Chaos to Official API: How We Rebuilt Our Cross-Border E-Commerce Backend

#api #architecture #backend #webscraping
Comments
2 min read
WAFER Deep Crawler: 8-Layer Stealth Architecture - Fingerprint Layer
chex0210crypto profile

WAFER Deep Crawler: 8-Layer Stealth Architecture - Fingerprint Layer

#webscraping #python #tutorial #selenium
5
Comments
3 min read
Heroku Is Getting Expensive: A 2026 Cost Calculator + Migration Guide
nexgendata profile

Heroku Is Getting Expensive: A 2026 Cost Calculator + Migration Guide

#api #webscraping #opensource #python
1
Comments 1
13 min read
How to Collect Product Data from a Website with Python
alock75 profile

How to Collect Product Data from a Website with Python

#python #webscraping #beginners #tutorial
1
Comments
3 min read
I Built a Tool to Track Which World Cup Players Are Blowing Up on Social Media
olams profile

I Built a Tool to Track Which World Cup Players Are Blowing Up on Social Media

#showdev #sideprojects #socialmedia #webscraping
1
Comments
3 min read
5 lessons from 5 interviews on AI agents and web scraping
neha_setia_334eebb931a08e profile

5 lessons from 5 interviews on AI agents and web scraping

#ai #agents #webscraping #devtools
Comments 2
5 min read
Anti bot protection
ayush9364 profile

Anti bot protection

#automation #webscraping #playwright #node
Comments
1 min read
How to Get Amazon Review & Rating Data at Scale (and What's Actually Public in 2026)
psymall profile

How to Get Amazon Review & Rating Data at Scale (and What's Actually Public in 2026)

#webscraping #python #api #ecommerce
2
Comments
3 min read
I built a tool that checks whether ChatGPT recommends your brand (Python + Apify)
chaazee profile

I built a tool that checks whether ChatGPT recommends your brand (Python + Apify)

#ai #python #seo #webscraping
2
Comments 1
7 min read
Expensive Discovery, Cheap Enrichment: A Marketplace Scraper Architecture Built Around Rate Limits
actorforge profile

Expensive Discovery, Cheap Enrichment: A Marketplace Scraper Architecture Built Around Rate Limits

#webscraping #architecture #api #node
Comments
13 min read
The Wildberries API in English: How to Get Products, Prices and Reviews as JSON
actorforge profile

The Wildberries API in English: How to Get Products, Prices and Reviews as JSON

#webscraping #api #javascript #ecommerce
1
Comments
13 min read
Your LLM can scrape the web — locally, without writing throwaway code
pxyup profile

Your LLM can scrape the web — locally, without writing throwaway code

#mcp #ai #webscraping #go
1
Comments 1
8 min read
What DIY web scraping really costs (2026 TCO breakdown)
promptcloud_services profile

What DIY web scraping really costs (2026 TCO breakdown)

#dataengineering #management #softwareengineering #webscraping
Comments
7 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.