DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Building a YouTube Scraper with Scrapy: A Developer's Journey
noorsimar profile

Building a YouTube Scraper with Scrapy: A Developer's Journey

#webscraping #python #opensource #youtube
4
Comments 2
4 min read
A Faster Approach to Email Validation: Why We Ditched Regex
notreeceharris profile

A Faster Approach to Email Validation: Why We Ditched Regex

#webdev #programming #javascript #webscraping
Comments
3 min read
Scraping Twitter in 2025: A Developer's Guide to Surviving the API Apocalypse
sivarampg profile

Scraping Twitter in 2025: A Developer's Guide to Surviving the API Apocalypse

#webdev #nextjs #webscraping #api
6
Comments 1
3 min read
BeautifulSoup vs lxml: A Practical Performance Comparison
dmitriiweb profile

BeautifulSoup vs lxml: A Practical Performance Comparison

#python #webscraping
2
Comments 1
3 min read
Building a Production-Ready LinkedIn Scraper with Python Scrapy 🐍
noorsimar profile

Building a Production-Ready LinkedIn Scraper with Python Scrapy 🐍

#webscraping #linkedin #datascience #scrapy
1
Comments 1
7 min read
🕸️ Web Scraping in Python: A Practical Guide for Data Scientists
vikas_gulia profile

🕸️ Web Scraping in Python: A Practical Guide for Data Scientists

#programming #datascience #webscraping #beginners
3
Comments
3 min read
AI-Ready Congressional Data: Building a Python Tool for Plaintext Extraction
b-d055 profile

AI-Ready Congressional Data: Building a Python Tool for Plaintext Extraction

#python #webscraping #government #ai
3
Comments
5 min read
Why your site needs a sitemap?
ritaly profile

Why your site needs a sitemap?

#webdev #seo #website #webscraping
31
Comments 4
3 min read
🧑‍💻 Web Scraping Indeed Remote Jobs and Storing in PostgreSQL
joe_siah profile

🧑‍💻 Web Scraping Indeed Remote Jobs and Storing in PostgreSQL

#webscraping #data #python
7
Comments 1
2 min read
How to Hide Cookie Banners with Puppeteer
geiger01 profile

How to Hide Cookie Banners with Puppeteer

#puppeteer #webscraping #webdev #javascript
6
Comments 1
3 min read
What is a Web-server?
vincenttommi profile

What is a Web-server?

#programming #webscraping #development #coding
1
Comments
2 min read
What Are Today’s Top Movie Plots? I Wrote a Python Scraper to Find Out
ahmad_azeez profile

What Are Today’s Top Movie Plots? I Wrote a Python Scraper to Find Out

#python #webscraping #movies #datascience
2
Comments 1
2 min read
How to Extract Links from a Sitemap
geiger01 profile

How to Extract Links from a Sitemap

#webscraping #node #webdev
2
Comments
5 min read
How I Use Perplexity AI for Web Scraping in Python (and Why You Probably Should Too)
lacrymosatech profile

How I Use Perplexity AI for Web Scraping in Python (and Why You Probably Should Too)

#perplexityai #webscraping #python #crawlbase
1
Comments
5 min read
Creating self-healing spiders with Scrapling in Python without AI (Web Scraping)
d4vinci profile

Creating self-healing spiders with Scrapling in Python without AI (Web Scraping)

#webscraping #python #ai #programming
14
Comments
10 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.