DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
8% of My Capterra Reviews Arrived as the Three Characters $62

8% of My Capterra Reviews Arrived as the Three Characters $62

Comments 2
6 min read
How sites answer GPTBot, classified in Python

How sites answer GPTBot, classified in Python

13
Comments 3
7 min read
Our job scraper was nearly 5x slower and costlier because of a proxy it never needed

Our job scraper was nearly 5x slower and costlier because of a proxy it never needed

Comments 1
5 min read
PHP cURL proxy: CURLOPT_PROXY, auth, SOCKS5 and errors

PHP cURL proxy: CURLOPT_PROXY, auth, SOCKS5 and errors

Comments
1 min read
How I Built a Web Scraper That Doesn’t Break in Production

How I Built a Web Scraper That Doesn’t Break in Production

15
Comments 8
11 min read
I benchmarked my website-to-Markdown crawler against Apify's Website Content Crawler on 5 real sites

I benchmarked my website-to-Markdown crawler against Apify's Website Content Crawler on 5 real sites

Comments 1
6 min read
Sales Navigator search export without cookies or a login: paste the URL in Claude Code, get the people from a B2B database

Sales Navigator search export without cookies or a login: paste the URL in Claude Code, get the people from a B2B database

3
Comments 6
10 min read
How to Bulk Download Images: From URL Lists to a ZIP File

How to Bulk Download Images: From URL Lists to a ZIP File

1
Comments 1
9 min read
Scraping websites and bot-protection

Scraping websites and bot-protection

7
Comments 2
9 min read
Daily price tracking for competitor hotels, with Python and SQLite

Daily price tracking for competitor hotels, with Python and SQLite

Comments 1
4 min read
How to get Google Hotels prices for any dates with Python (and see which booking site is cheapest)

How to get Google Hotels prices for any dates with Python (and see which booking site is cheapest)

Comments 1
5 min read
Google Ads Transparency Center scraper: 60 Nike ads, and 17 of the text ads had no text

Google Ads Transparency Center scraper: 60 Nike ads, and 17 of the text ads had no text

Comments
5 min read
LinkedIn people search without login: same 3 searches, 5 matches last week and 0 this week

LinkedIn people search without login: same 3 searches, 5 matches last week and 0 this week

Comments
5 min read
LinkedIn Ad Library: 40 HubSpot ads, and 23 came back with no impressions or targeting

LinkedIn Ad Library: 40 HubSpot ads, and 23 came back with no impressions or targeting

Comments
5 min read
C# HttpClient proxy: WebProxy, auth, SOCKS5 and rotation

C# HttpClient proxy: WebProxy, auth, SOCKS5 and rotation

Comments
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.