DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
The 1-in-3 Rule: What Actually Breaks in a Scraping Pipeline After 90 Days

The 1-in-3 Rule: What Actually Breaks in a Scraping Pipeline After 90 Days

Comments
6 min read
I Built a "Fastest Pizza Near Me" Tool with the UberEats API and Python

I Built a "Fastest Pizza Near Me" Tool with the UberEats API and Python

Comments
3 min read
I built a job search actor that aggregates 5 job boards - a $15/hour vs $50,000/year bug I found along the way

I built a job search actor that aggregates 5 job boards - a $15/hour vs $50,000/year bug I found along the way

Comments
2 min read
A permissive robots.txt is not a licence

A permissive robots.txt is not a licence

2
Comments 8
4 min read
I Built a Restaurant Lead List for My Agency in 10 Minutes with UberEats Data

I Built a Restaurant Lead List for My Agency in 10 Minutes with UberEats Data

Comments
4 min read
Compare Scraping APIs by Cost per Delivered Record, Not Request Price

Compare Scraping APIs by Cost per Delivered Record, Not Request Price

Comments
4 min read
Session Reuse and Browser Mode Decisions for Web Data Pipelines

Session Reuse and Browser Mode Decisions for Web Data Pipelines

Comments
4 min read
pytrends Is Dead. Here's How to Get Google Trends Data in 2026

pytrends Is Dead. Here's How to Get Google Trends Data in 2026

Comments
4 min read
How to Build a Web Crawler with Scrapy

How to Build a Web Crawler with Scrapy

Comments
5 min read
Scraping platform costs: measure successful rows, not browser minutes

Scraping platform costs: measure successful rows, not browser minutes

Comments
4 min read
Weibo's trending endpoint returns words, not posts — the one that returns the thread

Weibo's trending endpoint returns words, not posts — the one that returns the thread

Comments
3 min read
Your scraper isn't broken. The site changed, and it didn't tell you.

Your scraper isn't broken. The site changed, and it didn't tell you.

Comments 1
4 min read
How to Scrape JavaScript-Heavy Sites with Playwright

How to Scrape JavaScript-Heavy Sites with Playwright

Comments
5 min read
Build a Job Board Scraper to Find Remote Opportunities

Build a Job Board Scraper to Find Remote Opportunities

Comments
4 min read
Scraping bilingual data: the Arabic/English traps that quietly corrupt your dataset

Scraping bilingual data: the Arabic/English traps that quietly corrupt your dataset

Comments
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.