DEV Community

# webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
3 Subtle Mistakes That Slowed Down My Web App (And How I Fixed Them)

3 Subtle Mistakes That Slowed Down My Web App (And How I Fixed Them)

Comments
1 min read
5 best JavaScript web scraping libraries in 2025

5 best JavaScript web scraping libraries in 2025

1
Comments
7 min read
Beautiful Soup: Web Scraping's Delightful Deception

Beautiful Soup: Web Scraping's Delightful Deception

Comments
2 min read
🕷️For Developers Losing Hair Over Web Scraping: Is a Scraper API Your Lifesaver?

🕷️For Developers Losing Hair Over Web Scraping: Is a Scraper API Your Lifesaver?

2
Comments
2 min read
I Tested 25+ (Free & Paid) Web Scraping Tools - These 8 Are the Absolute Best

I Tested 25+ (Free & Paid) Web Scraping Tools - These 8 Are the Absolute Best

15
Comments
8 min read
🕸️ Web Scraping in Python: A Practical Guide for Data Scientists

🕸️ Web Scraping in Python: A Practical Guide for Data Scientists

1
Comments
3 min read
Using FireCrawl MCP Server with Claude for Web Scraping

Using FireCrawl MCP Server with Claude for Web Scraping

24
Comments 3
5 min read
How to scrape YouTube using Python [2025 guide]

How to scrape YouTube using Python [2025 guide]

7
Comments
18 min read
I Built a Node.js App That Tracks UK Supermarket Prices and Saved Me £300 This Month (Also My Neighbors Love It)

I Built a Node.js App That Tracks UK Supermarket Prices and Saved Me £300 This Month (Also My Neighbors Love It)

20
Comments
6 min read
Analysed over 500+ publicly available workflow templates

Analysed over 500+ publicly available workflow templates

Comments
1 min read
Building a YouTube Scraper with Scrapy: A Developer's Journey

Building a YouTube Scraper with Scrapy: A Developer's Journey

3
Comments 1
4 min read
How to Evade Web Scraping Bans

How to Evade Web Scraping Bans

Comments
5 min read
How I Scraped our Private Google Site in a Semi-Automated way

How I Scraped our Private Google Site in a Semi-Automated way

Comments
7 min read
Building a Production-Ready LinkedIn Scraper with Python Scrapy 🐍

Building a Production-Ready LinkedIn Scraper with Python Scrapy 🐍

1
Comments 1
7 min read
I Tried 15+ Web Scraping Tools — Here's the Only One I'd Trust for Big Data Projects

I Tried 15+ Web Scraping Tools — Here's the Only One I'd Trust for Big Data Projects

10
Comments
7 min read
3 bewährte Wege für den HTML-zu-Excel-Export

3 bewährte Wege für den HTML-zu-Excel-Export

Comments 1
1 min read
From 500+ Lines to 150: How I Refactored My Amazon Scraper Into a Clean Scrapy Project

From 500+ Lines to 150: How I Refactored My Amazon Scraper Into a Clean Scrapy Project

Comments 2
4 min read
Mastering Residential Proxies with Python

Mastering Residential Proxies with Python

Comments
2 min read
AI-Ready Congressional Data: Building a Python Tool for Plaintext Extraction

AI-Ready Congressional Data: Building a Python Tool for Plaintext Extraction

3
Comments
5 min read
Web Scraping to SQL: How to Effectively Store and Analyze Your Scraped Data

Web Scraping to SQL: How to Effectively Store and Analyze Your Scraped Data

Comments
5 min read
Why your site needs a sitemap?

Why your site needs a sitemap?

31
Comments 4
3 min read
Google blocks Yandex: A Tale of Two robots.txt Files

Google blocks Yandex: A Tale of Two robots.txt Files

Comments
2 min read
Finding Hidden Comic Book Deals: A TypeScript Scraping Solution

Finding Hidden Comic Book Deals: A TypeScript Scraping Solution

1
Comments
6 min read
How to Block Requests with Puppeteer

How to Block Requests with Puppeteer

Comments
5 min read
How to Hide Cookie Banners with Puppeteer

How to Hide Cookie Banners with Puppeteer

6
Comments
3 min read
loading...