DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Scrape Wikipedia in 4mâ™­ (four minutes flat)

Scrape Wikipedia in 4mâ™­ (four minutes flat)

Comments
6 min read
Google Ads Transparency Center API: export a competitor's Google ads

Google Ads Transparency Center API: export a competitor's Google ads

5
Comments 4
3 min read
Get every open job from Greenhouse, Lever and Ashby in 40 lines of Python

Get every open job from Greenhouse, Lever and Ashby in 40 lines of Python

Comments
4 min read
Apple's app review RSS feed is empty now — here's what the App Store itself uses

Apple's app review RSS feed is empty now — here's what the App Store itself uses

Comments
4 min read
Korean cosmetic labels are in Korean. I mapped 50,000 ingredient entries to English INCI names — here's what matched and what broke.

Korean cosmetic labels are in Korean. I mapped 50,000 ingredient entries to English INCI names — here's what matched and what broke.

1
Comments
4 min read
Scrapy vs BeautifulSoup for Public-Data Collection: Where Each One Starts Costing You

Scrapy vs BeautifulSoup for Public-Data Collection: Where Each One Starts Costing You

Comments 1
2 min read
Scrape LinkedIn Jobs Without Login or API Key (Half Were Recruiters)

Scrape LinkedIn Jobs Without Login or API Key (Half Were Recruiters)

Comments 1
7 min read
Reddit API Shutdown: 7 Ways to Get Reddit Data in 2026

Reddit API Shutdown: 7 Ways to Get Reddit Data in 2026

1
Comments
9 min read
How to Get Coles and Woolworths Grocery Prices Without Coding (2026)

How to Get Coles and Woolworths Grocery Prices Without Coding (2026)

Comments
3 min read
Reading Workday job postings as JSON, and getting past the 2,000-result ceiling

Reading Workday job postings as JSON, and getting past the 2,000-result ceiling

Comments 2
8 min read
I checked a million free proxies. One in five of the working ones rewrote my pages.

I checked a million free proxies. One in five of the working ones rewrote my pages.

Comments
3 min read
I Crawled 554 SaaS Affiliate Pages. My Parser Lied to Me Nine Times.

I Crawled 554 SaaS Affiliate Pages. My Parser Lied to Me Nine Times.

Comments 1
14 min read
Aldi Netherlands, Aldi Nord and Aldi SĂĽd shelf prices in EUR

Aldi Netherlands, Aldi Nord and Aldi SĂĽd shelf prices in EUR

1
Comments
5 min read
Apple's review feed went quiet, and my scraper believed it

Apple's review feed went quiet, and my scraper believed it

1
Comments 1
7 min read
AI Agent Web Scraping Playwright: Zero-Cost 45s Blueprint

AI Agent Web Scraping Playwright: Zero-Cost 45s Blueprint

1
Comments
8 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.