DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Geo-Targeted Web Scraping with Proxies: Country & City-Level Guide

Geo-Targeted Web Scraping with Proxies: Country & City-Level Guide

17
Comments 2
11 min read
Getting trade fair exhibitor lists (MEDICA, K, ProWein) as JSON with Python

Getting trade fair exhibitor lists (MEDICA, K, ProWein) as JSON with Python

Comments
4 min read
App Release Operations Product: From Build Status to Phased Release

App Release Operations Product: From Build Status to Phased Release

Comments
40 min read
Seven Runs Took the First 100 TikTok Comments. None of Them Had the 185-Like One

Seven Runs Took the First 100 TikTok Comments. None of Them Had the 185-Like One

Comments
6 min read
How to Give Claude Desktop & Cursor Real-Time Web Access (Without Getting Blocked by Cloudflare)

How to Give Claude Desktop & Cursor Real-Time Web Access (Without Getting Blocked by Cloudflare)

Comments
2 min read
Find the email behind any website with 70 lines of Python (incl. Cloudflare-hidden ones)

Find the email behind any website with 70 lines of Python (incl. Cloudflare-hidden ones)

Comments
4 min read
How to Scrape Twitch with Go: Chat Logs over IRC WebSockets, Moderation Events, Full-Text Search, and Chat Stats (2026)

How to Scrape Twitch with Go: Chat Logs over IRC WebSockets, Moderation Events, Full-Text Search, and Chat Stats (2026)

Comments
25 min read
BeautifulSoup find() Returns None? Debug the HTML requests Got, Not the Page DevTools Shows

BeautifulSoup find() Returns None? Debug the HTML requests Got, Not the Page DevTools Shows

Comments
5 min read
Track competitor prices daily with Python

Track competitor prices daily with Python

Comments
8 min read
n8n proxy setup: HTTP Request node, env vars and SOCKS5

n8n proxy setup: HTTP Request node, env vars and SOCKS5

Comments
2 min read
How to scrape LinkedIn, Reed and Totaljobs jobs in one run with Python

How to scrape LinkedIn, Reed and Totaljobs jobs in one run with Python

Comments
5 min read
How to get every job from a company's careers page as JSON (Greenhouse, Lever, Ashby and 7 more)

How to get every job from a company's careers page as JSON (Greenhouse, Lever, Ashby and 7 more)

Comments
3 min read
I Asked Apple's Search API for 20 VPN Apps and Got 18. Asking for 200 Gets You 189

I Asked Apple's Search API for 20 VPN Apps and Got 18. Asking for 200 Gets You 189

Comments
7 min read
I Checked Eleven Job Links for Liveness. The Status Code Was the Wrong Tool.

I Checked Eleven Job Links for Liveness. The Status Code Was the Wrong Tool.

Comments
4 min read
Reddit posts and comments scraper with n8n (free workflow)

Reddit posts and comments scraper with n8n (free workflow)

Comments
5 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.