DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
What 500,000 pages a month costs on 8 scraping APIs

What 500,000 pages a month costs on 8 scraping APIs

Comments
8 min read
Austria apartments for rent: a daily new-listings feed from ImmoScout24 (Python)

Austria apartments for rent: a daily new-listings feed from ImmoScout24 (Python)

Comments
5 min read
How to scrape Vinted listings and compare prices across countries with Python

How to scrape Vinted listings and compare prices across countries with Python

Comments
6 min read
I Registered Fresh Accounts on 5 Amazon Scraper APIs and Ran the Same Test on All of Them

I Registered Fresh Accounts on 5 Amazon Scraper APIs and Ran the Same Test on All of Them

1
Comments
8 min read
Download all images from a web page with Python (srcset, lazy loading and og:image included)

Download all images from a web page with Python (srcset, lazy loading and og:image included)

Comments
6 min read
Building German B2B lead lists from Gelbe Seiten with Python

Building German B2B lead lists from Gelbe Seiten with Python

1
Comments
4 min read
Google Hotels Printed $17 for a Stay It Itemised at $16.66

Google Hotels Printed $17 for a Stay It Itemised at $16.66

1
Comments
6 min read
75 LinkedIn Posts Carried 16,552 Comments. I Could Read 669 of Them

75 LinkedIn Posts Carried 16,552 Comments. I Could Read 669 of Them

Comments
6 min read
Scraping Czech property auctions (portaldrazeb.cz) into JSON with Python

Scraping Czech property auctions (portaldrazeb.cz) into JSON with Python

Comments
4 min read
Extract every URL from a sitemap.xml in Python (indexes, .gz, robots.txt) and spot competitors' new pages

Extract every URL from a sitemap.xml in Python (indexes, .gz, robots.txt) and spot competitors' new pages

Comments
4 min read
How to Scrape Google Jobs in 2026 (Salaries + Direct Apply Links, No Code)

How to Scrape Google Jobs in 2026 (Salaries + Direct Apply Links, No Code)

Comments
4 min read
Greenhouse, Lever, Ashby, Workable & SmartRecruiters job APIs: endpoints, fields and one normalized feed (2026)

Greenhouse, Lever, Ashby, Workable & SmartRecruiters job APIs: endpoints, fields and one normalized feed (2026)

Comments
4 min read
pytrends is archived and throws 429s. What still works for Google Trends data in 2026

pytrends is archived and throws 429s. What still works for Google Trends data in 2026

Comments
7 min read
Measuring ChatGPT answers means measuring the product, not the model API

Measuring ChatGPT answers means measuring the product, not the model API

Comments 1
4 min read
How to Recover a Website's Lost Images from the Wayback Machine (in Bulk, with Python)

How to Recover a Website's Lost Images from the Wayback Machine (in Bulk, with Python)

Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.