Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
webscraping
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
I Tested 25+ (Free & Paid) Web Scraping Tools - These 8 Are the Absolute Best
Nitin Sharma
Nitin Sharma
Nitin Sharma
Follow
Jul 22 '25
I Tested 25+ (Free & Paid) Web Scraping Tools - These 8 Are the Absolute Best
#
webscraping
#
ai
#
productivity
#
beginners
15
reactions
Comments
1
comment
8 min read
Using FireCrawl MCP Server with Claude for Web Scraping
Rohith Singh
Rohith Singh
Rohith Singh
Follow
for
Composio
Jul 23 '25
Using FireCrawl MCP Server with Claude for Web Scraping
#
webdev
#
webscraping
#
mcp
#
ai
24
reactions
Comments
3
comments
5 min read
How to scrape YouTube using Python [2025 guide]
Max Bohomolov
Max Bohomolov
Max Bohomolov
Follow
for
Crawlee
Jul 16 '25
How to scrape YouTube using Python [2025 guide]
#
webscraping
#
webdev
#
python
#
developers
7
reactions
Comments
Add Comment
18 min read
I Built a Node.js App That Tracks UK Supermarket Prices and Saved Me £300 This Month (Also My Neighbors Love It)
shiva shanker
shiva shanker
shiva shanker
Follow
Jul 16 '25
I Built a Node.js App That Tracks UK Supermarket Prices and Saved Me £300 This Month (Also My Neighbors Love It)
#
node
#
puppet
#
savings
#
webscraping
21
reactions
Comments
1
comment
6 min read
Analysed over 500+ publicly available workflow templates
Agent_ummi
Agent_ummi
Agent_ummi
Follow
Jun 7 '25
Analysed over 500+ publicly available workflow templates
#
automaton
#
webscraping
Comments
Add Comment
1 min read
Building a YouTube Scraper with Scrapy: A Developer's Journey
Noorsimar Singh
Noorsimar Singh
Noorsimar Singh
Follow
Jul 10 '25
Building a YouTube Scraper with Scrapy: A Developer's Journey
#
webscraping
#
python
#
opensource
#
youtube
3
reactions
Comments
1
comment
4 min read
Scraping Twitter in 2025: A Developer's Guide to Surviving the API Apocalypse
Sivaram
Sivaram
Sivaram
Follow
Jul 9 '25
Scraping Twitter in 2025: A Developer's Guide to Surviving the API Apocalypse
#
webdev
#
nextjs
#
webscraping
#
api
6
reactions
Comments
Add Comment
3 min read
How I Scraped our Private Google Site in a Semi-Automated way
Saugata Roy Arghya
Saugata Roy Arghya
Saugata Roy Arghya
Follow
Jul 5 '25
How I Scraped our Private Google Site in a Semi-Automated way
#
playwright
#
googlesite
#
webscraping
#
automation
Comments
Add Comment
7 min read
Building a Production-Ready LinkedIn Scraper with Python Scrapy 🐍
Noorsimar Singh
Noorsimar Singh
Noorsimar Singh
Follow
Jul 2 '25
Building a Production-Ready LinkedIn Scraper with Python Scrapy 🐍
#
webscraping
#
linkedin
#
datascience
#
scrapy
1
reaction
Comments
1
comment
7 min read
I Tried 15+ Web Scraping Tools — Here's the Only One I'd Trust for Big Data Projects
Nitin Sharma
Nitin Sharma
Nitin Sharma
Follow
Jul 2 '25
I Tried 15+ Web Scraping Tools — Here's the Only One I'd Trust for Big Data Projects
#
webscraping
#
programming
#
ai
#
productivity
10
reactions
Comments
Add Comment
7 min read
3 bewährte Wege für den HTML-zu-Excel-Export
hanna Fischer
hanna Fischer
hanna Fischer
Follow
Jun 11 '25
3 bewährte Wege für den HTML-zu-Excel-Export
#
webscraping
#
html
#
excel
#
automation
Comments
1
comment
1 min read
From 500+ Lines to 150: How I Refactored My Amazon Scraper Into a Clean Scrapy Project
Noorsimar Singh
Noorsimar Singh
Noorsimar Singh
Follow
Jun 25 '25
From 500+ Lines to 150: How I Refactored My Amazon Scraper Into a Clean Scrapy Project
#
webscraping
#
scrapy
#
scrapeops
#
python
Comments
2
comments
4 min read
AI-Ready Congressional Data: Building a Python Tool for Plaintext Extraction
Bryan Doss
Bryan Doss
Bryan Doss
Follow
May 17 '25
AI-Ready Congressional Data: Building a Python Tool for Plaintext Extraction
#
python
#
webscraping
#
government
#
ai
3
reactions
Comments
Add Comment
5 min read
Web Scraping to SQL: How to Effectively Store and Analyze Your Scraped Data
LacrymosaTech
LacrymosaTech
LacrymosaTech
Follow
May 12 '25
Web Scraping to SQL: How to Effectively Store and Analyze Your Scraped Data
#
sql
#
database
#
datascience
#
webscraping
Comments
Add Comment
5 min read
Why your site needs a sitemap?
Rita {FlyNerd} Lyczywek
Rita {FlyNerd} Lyczywek
Rita {FlyNerd} Lyczywek
Follow
Jun 15 '25
Why your site needs a sitemap?
#
webdev
#
seo
#
website
#
webscraping
31
reactions
Comments
4
comments
3 min read
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account