DEV Community

# webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
I Built an AI Extraction API, Got Zero Paying Users, Then Rebuilt the Whole Engine

I Built an AI Extraction API, Got Zero Paying Users, Then Rebuilt the Whole Engine

1
Comments
3 min read
From a Single IP to Exfiltrated Passwords in a PNG: My First Freelance Pentest Engagement

From a Single IP to Exfiltrated Passwords in a PNG: My First Freelance Pentest Engagement

Comments
13 min read
You're Using ScraperAPI or Scrape.do. You're Still Writing Parsers. There's a Better Way.

You're Using ScraperAPI or Scrape.do. You're Still Writing Parsers. There's a Better Way.

1
Comments
3 min read
Your recurring scraper is re-downloading data that didn't change. Here's the 15-line fix (conditional GET)

Your recurring scraper is re-downloading data that didn't change. Here's the 15-line fix (conditional GET)

2
Comments
5 min read
I Built a Telegram Bot That Searches, Monitors Prices and Lets You Buy and Sell. Here's How

I Built a Telegram Bot That Searches, Monitors Prices and Lets You Buy and Sell. Here's How

Comments
3 min read
6 Firecrawl Alternatives for Developers in 2026

6 Firecrawl Alternatives for Developers in 2026

1
Comments
9 min read
Best Puppeteer Alternatives for Browser Automation in 2026

Best Puppeteer Alternatives for Browser Automation in 2026

1
Comments
8 min read
I Built a Skill That Pulls Any Australian Real Estate Agent's Sales History in 60 Seconds

I Built a Skill That Pulls Any Australian Real Estate Agent's Sales History in 60 Seconds

Comments
7 min read
Every web-data tool says it's "built for AI." I asked the AI.

Every web-data tool says it's "built for AI." I asked the AI.

2
Comments 1
5 min read
Mouse Movement, Typing Speed, and Why Your Bot Still Gets Caught After Fixing TLS

Mouse Movement, Typing Speed, and Why Your Bot Still Gets Caught After Fixing TLS

Comments
5 min read
How to Scrape Websites for AI Training Data & RAG Pipelines with Python

How to Scrape Websites for AI Training Data & RAG Pipelines with Python

1
Comments
10 min read
Scrapy AutoThrottle: How to tune crawl speed without getting blocked

Scrapy AutoThrottle: How to tune crawl speed without getting blocked

Comments
6 min read
Cloudflare Turnstile in Playwright: Why Your Tests Stall and How to Solve It in 8 Lines

Cloudflare Turnstile in Playwright: Why Your Tests Stall and How to Solve It in 8 Lines

Comments
5 min read
LinkedIn Scraping with Python: Profiles, Jobs & Company Pages

LinkedIn Scraping with Python: Profiles, Jobs & Company Pages

Comments
9 min read
My Google Maps scraper is live for 2 weeks. Half the emails were bounce-bait — here's what I added.

My Google Maps scraper is live for 2 weeks. Half the emails were bounce-bait — here's what I added.

Comments 1
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.