DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Web Scraping with Node.js: Puppeteer vs Cheerio (Complete 2026 Guide)

Web Scraping with Node.js: Puppeteer vs Cheerio (Complete 2026 Guide)

Comments
5 min read
Stop Scraping Betting Sites: How to Build a Real-Time Sports Tracker in Python

Stop Scraping Betting Sites: How to Build a Real-Time Sports Tracker in Python

Comments
3 min read
What I learned scraping 141 crypto cardholder agreements

What I learned scraping 141 crypto cardholder agreements

Comments
5 min read
Benchmarking Residential Proxy Providers: A Reproducible Test Script

Benchmarking Residential Proxy Providers: A Reproducible Test Script

Comments 1
4 min read
Network-layer scraping is fast, but the maintenance cost is the real decision

Network-layer scraping is fast, but the maintenance cost is the real decision

Comments 3
5 min read
Your LLM Pipeline Is Choking on Raw HTML. Here's the Fix.

Your LLM Pipeline Is Choking on Raw HTML. Here's the Fix.

Comments
3 min read
How to Extract Structured Data from A Website

How to Extract Structured Data from A Website

Comments
8 min read
Synthesio charges $36K+/year for Chinese platform coverage. I built one for $0.045/mention.

Synthesio charges $36K+/year for Chinese platform coverage. I built one for $0.045/mention.

Comments
8 min read
Migration Playbook: Cron Script Actor. Six Steps, No Rewrites.

Migration Playbook: Cron Script Actor. Six Steps, No Rewrites.

2
Comments
4 min read
How We Built a WAF-Resilient, Selector-Free Web Scraper in Python (Using Gemini 2.5 & Playwright)

How We Built a WAF-Resilient, Selector-Free Web Scraper in Python (Using Gemini 2.5 & Playwright)

Comments 1
3 min read
How to Scrape JS-Rendered E-Commerce Pages Without Getting Blocked (2026 Guide)

How to Scrape JS-Rendered E-Commerce Pages Without Getting Blocked (2026 Guide)

Comments
2 min read
XCrawl vs Puppeteer vs Playwright: Which Web Scraping Tool Saves You More Time in 2026?

XCrawl vs Puppeteer vs Playwright: Which Web Scraping Tool Saves You More Time in 2026?

Comments
2 min read
Stop Building Fragile Scrapers — Build Actors Instead

Stop Building Fragile Scrapers — Build Actors Instead

Comments
4 min read
AI-Powered Web Scraper

AI-Powered Web Scraper

Comments
4 min read
I scraped every **Show HN** post from May 2025 to May 2026 that crossed **200 points** and ran a quick analysis. There were 334 of them. Here is what landed.

I scraped every **Show HN** post from May 2025 to May 2026 that crossed **200 points** and ran a quick analysis. There were 334 of them. Here is what landed.

Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.