DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
6 Firecrawl Alternatives for Developers in 2026

6 Firecrawl Alternatives for Developers in 2026

1
Comments
9 min read
Best Puppeteer Alternatives for Browser Automation in 2026

Best Puppeteer Alternatives for Browser Automation in 2026

1
Comments
8 min read
Every web-data tool says it's "built for AI." I asked the AI.

Every web-data tool says it's "built for AI." I asked the AI.

2
Comments 1
5 min read
I Built a Skill That Pulls Any Australian Real Estate Agent's Sales History in 60 Seconds

I Built a Skill That Pulls Any Australian Real Estate Agent's Sales History in 60 Seconds

Comments
7 min read
Mouse Movement, Typing Speed, and Why Your Bot Still Gets Caught After Fixing TLS

Mouse Movement, Typing Speed, and Why Your Bot Still Gets Caught After Fixing TLS

Comments
5 min read
How to Scrape Websites for AI Training Data & RAG Pipelines with Python

How to Scrape Websites for AI Training Data & RAG Pipelines with Python

1
Comments
10 min read
Scrapy AutoThrottle: How to tune crawl speed without getting blocked

Scrapy AutoThrottle: How to tune crawl speed without getting blocked

Comments
6 min read
Cloudflare Turnstile in Playwright: Why Your Tests Stall and How to Solve It in 8 Lines

Cloudflare Turnstile in Playwright: Why Your Tests Stall and How to Solve It in 8 Lines

Comments
5 min read
LinkedIn Scraping with Python: Profiles, Jobs & Company Pages

LinkedIn Scraping with Python: Profiles, Jobs & Company Pages

1
Comments 2
9 min read
Web Scraping Kenyan Data Sources: What's Available, What Fights Back, and the Patterns That Keep Pipelines Running

Web Scraping Kenyan Data Sources: What's Available, What Fights Back, and the Patterns That Keep Pipelines Running

1
Comments 1
12 min read
My Google Maps scraper is live for 2 weeks. Half the emails were bounce-bait — here's what I added.

My Google Maps scraper is live for 2 weeks. Half the emails were bounce-bait — here's what I added.

Comments 1
4 min read
Web Scraping with Python: A Complete BeautifulSoup & Requests Guide

Web Scraping with Python: A Complete BeautifulSoup & Requests Guide

Comments
9 min read
When your web extraction tool should fail loudly instead of returning pretty lies

When your web extraction tool should fail loudly instead of returning pretty lies

2
Comments
3 min read
What I Learned After Testing Different Proxy Setups for Web Scraping

What I Learned After Testing Different Proxy Setups for Web Scraping

Comments
2 min read
Real-Browser Agent Prompts: 6 AI Workflows for Market Research, Competitor Research, and Brand Monitoring

Real-Browser Agent Prompts: 6 AI Workflows for Market Research, Competitor Research, and Brand Monitoring

1
Comments
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.