DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Web Scraping for OSINT: Start With the API, Not the HTML

Web Scraping for OSINT: Start With the API, Not the HTML

Comments
6 min read
Local Business Lead Scrapers on Apify Compared (September 2026)

Local Business Lead Scrapers on Apify Compared (September 2026)

Comments 1
7 min read
How We Built Perceive: Web Content Extraction for RAG Pipelines

How We Built Perceive: Web Content Extraction for RAG Pipelines

Comments 1
8 min read
Shopify's Open Secret: Every Store Exposes /products.json

Shopify's Open Secret: Every Store Exposes /products.json

Comments
2 min read
Indeed 403s you with zero bytes. The companies it aggregates publish free APIs.

Indeed 403s you with zero bytes. The companies it aggregates publish free APIs.

Comments
6 min read
YouTube Channel Scraper in Python: Filter Active Creators

YouTube Channel Scraper in Python: Filter Active Creators

Comments 1
3 min read
Our build wave shipped four scrapers that scraped nothing

Our build wave shipped four scrapers that scraped nothing

Comments 1
4 min read
Datacenter vs Residential Proxies: Complete Comparison Guide

Datacenter vs Residential Proxies: Complete Comparison Guide

Comments
5 min read
Inside Instagram's Anti-Bot Stack: What Actually Catches You

Inside Instagram's Anti-Bot Stack: What Actually Catches You

1
Comments
6 min read
The 1-in-3 Rule: What Actually Breaks in a Scraping Pipeline After 90 Days

The 1-in-3 Rule: What Actually Breaks in a Scraping Pipeline After 90 Days

Comments
6 min read
I Built a "Fastest Pizza Near Me" Tool with the UberEats API and Python

I Built a "Fastest Pizza Near Me" Tool with the UberEats API and Python

Comments
3 min read
Only 18.5% of the web is open. What an audit of 24,898 sites tells scraper engineers

Only 18.5% of the web is open. What an audit of 24,898 sites tells scraper engineers

Comments
12 min read
My Research Journal: Why I Decided to Start Doing Research & What I Learned

My Research Journal: Why I Decided to Start Doing Research & What I Learned

Comments
4 min read
Three registers, three alphabets, no APIs: building pay-per-event actors for company data

Three registers, three alphabets, no APIs: building pay-per-event actors for company data

1
Comments 1
10 min read
I Built a Restaurant Lead List for My Agency in 10 Minutes with UberEats Data

I Built a Restaurant Lead List for My Agency in 10 Minutes with UberEats Data

Comments
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.