DEV Community

# webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Cloudflare Turnstile in Playwright: Why Your Tests Stall and How to Solve It in 8 Lines
bshahin profile

Cloudflare Turnstile in Playwright: Why Your Tests Stall and How to Solve It in 8 Lines

#webscraping #python #automation #captcha
Comments
5 min read
LinkedIn Scraping with Python: Profiles, Jobs & Company Pages
zyvop profile
ZyVOP

LinkedIn Scraping with Python: Profiles, Jobs & Company Pages

#linkedin #playwright #webscraping #python
1
Comments 2
9 min read
Web Scraping Kenyan Data Sources: What's Available, What Fights Back, and the Patterns That Keep Pipelines Running
de_clerke profile

Web Scraping Kenyan Data Sources: What's Available, What Fights Back, and the Patterns That Keep Pipelines Running

#webscraping #beautifulsoup #playwright #requests
1
Comments 1
12 min read
My Google Maps scraper is live for 2 weeks. Half the emails were bounce-bait — here's what I added.
projectdev profile

My Google Maps scraper is live for 2 weeks. Half the emails were bounce-bait — here's what I added.

#webscraping #node #b2b #leadgen
Comments 1
4 min read
Web Scraping with Python: A Complete BeautifulSoup & Requests Guide
zyvop profile
ZyVOP

Web Scraping with Python: A Complete BeautifulSoup & Requests Guide

#python #webscraping #beautifulsoup #requests
Comments
9 min read
When your web extraction tool should fail loudly instead of returning pretty lies
zee_builds profile
Zee

When your web extraction tool should fail loudly instead of returning pretty lies

#python #webscraping #ai #mcp
2
Comments
3 min read
What I Learned After Testing Different Proxy Setups for Web Scraping
sebastian_rantala_1e41c8f profile

What I Learned After Testing Different Proxy Setups for Web Scraping

#automation #networking #performance #webscraping
Comments
2 min read
Real-Browser Agent Prompts: 6 AI Workflows for Market Research, Competitor Research, and Brand Monitoring
eliofbm profile
Eli

Real-Browser Agent Prompts: 6 AI Workflows for Market Research, Competitor Research, and Brand Monitoring

#agents #ai #automation #webscraping
1
Comments
6 min read
Why Data Contracts Will Replace Ad-Hoc Scraping Pipelines
promptcloud_services profile

Why Data Contracts Will Replace Ad-Hoc Scraping Pipelines

#webscraping
Comments
5 min read
How to tell if a page uses JavaScript rendering (and what to do about it)
john_rooney profile

How to tell if a page uses JavaScript rendering (and what to do about it)

#webscraping #zyte #programming #rendering
Comments
11 min read
I Turned My Browser Into a Terminal — And Now I Can Control Any Website From the Command Line
tenglongai2026 profile

I Turned My Browser Into a Terminal — And Now I Can Control Any Website From the Command Line

#opensource #cli #webscraping #productivity
5
Comments 4
2 min read
Discogs Price Scraper: pull every marketplace listing as clean JSON
devil_scrapes profile

Discogs Price Scraper: pull every marketplace listing as clean JSON

#webscraping #python #apify #music
1
Comments
8 min read
I Tested Every Web Scraping Tool Against Lazada — Here's What Actually Works (May 2026)
mariatanbobo profile

I Tested Every Web Scraping Tool Against Lazada — Here's What Actually Works (May 2026)

#webscraping #python #ai #devops
Comments
7 min read
I built a competitor pricing monitor in 3 days, here's how it actually works
erramix01 profile

I built a competitor pricing monitor in 3 days, here's how it actually works

#showdev #automation #nextjs #webscraping
Comments
2 min read
Three memory-leak patterns in long-running scrapers (and how I caught them after 968 Trustpilot runs)
0012303 profile

Three memory-leak patterns in long-running scrapers (and how I caught them after 968 Trustpilot runs)

#webscraping #python #ai #apify
1
Comments 2
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.