DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Beyond requests.get: Analyzing the Architecture of an AI-Generated Spider

Beyond requests.get: Analyzing the Architecture of an AI-Generated Spider

1
Comments
5 min read
Market Research Scraping: Why Residential Proxies Sometimes Matter More Than Scale

Market Research Scraping: Why Residential Proxies Sometimes Matter More Than Scale

Comments
3 min read
Shopify Store Scraping: Extract Product Data, Reviews and Inventory

Shopify Store Scraping: Extract Product Data, Reviews and Inventory

4
Comments 2
7 min read
Booking.com Scraping: Extract Hotel Listings, Prices, and Reviews

Booking.com Scraping: Extract Hotel Listings, Prices, and Reviews

Comments
7 min read
eBay Scraping: Extract Product Listings, Prices, and Seller Data

eBay Scraping: Extract Product Listings, Prices, and Seller Data

Comments
8 min read
How to Scrape Etsy Product Data at Scale (2026 Guide)

How to Scrape Etsy Product Data at Scale (2026 Guide)

Comments
7 min read
SoundCloud Scraping: Extract Tracks, Artists, and Playlist Data

SoundCloud Scraping: Extract Tracks, Artists, and Playlist Data

Comments
11 min read
A Record Growth Day Revealed Who's Actually Using My Korean Scrapers

A Record Growth Day Revealed Who's Actually Using My Korean Scrapers

1
Comments
4 min read
How to Build a Website Change Detector in 30 Lines of Code

How to Build a Website Change Detector in 30 Lines of Code

1
Comments
4 min read
Share of Shelf Analysis: How to Scrape Zappos Search Results

Share of Shelf Analysis: How to Scrape Zappos Search Results

1
Comments
4 min read
I Built the API GSMArena Never Had (Mobile Specs + DXOMark Data)

I Built the API GSMArena Never Had (Mobile Specs + DXOMark Data)

2
Comments 1
2 min read
Meta's AI Crawler Scraped My Site 7.9 Million Times: How I Survived 900+ GB of Bandwidth Chaos

Meta's AI Crawler Scraped My Site 7.9 Million Times: How I Survived 900+ GB of Bandwidth Chaos

Comments 1
3 min read
Bypassing Apple's Anti-Bot Systems: The Ultimate Guide to App Store Scraping

Bypassing Apple's Anti-Bot Systems: The Ultimate Guide to App Store Scraping

Comments
6 min read
Steal My Workflow: Scraping the iOS App Store to Find High-LTV Subscription Apps

Steal My Workflow: Scraping the iOS App Store to Find High-LTV Subscription Apps

1
Comments
6 min read
Bulletproof Data Pipelines: Adding Schema Validation to Nike Scrapers

Bulletproof Data Pipelines: Adding Schema Validation to Nike Scrapers

2
Comments
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.