DEV Community

# webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
How to scrape Redfin (US real estate) data with Node.js (no API key needed)

How to scrape Redfin (US real estate) data with Node.js (no API key needed)

Comments
4 min read
How to scrape Shopify App Store data with Python (no API key needed)

How to scrape Shopify App Store data with Python (no API key needed)

Comments
4 min read
When AI Agents Should Stop Using Browsers for Web Data

When AI Agents Should Stop Using Browsers for Web Data

1
Comments 1
5 min read
I scraped 50,000 G2 reviews to map the 2026 SaaS Battlecard Atlas

I scraped 50,000 G2 reviews to map the 2026 SaaS Battlecard Atlas

1
Comments
8 min read
Building a self-hosted browser scraping service (is it more hassle than its worth?)

Building a self-hosted browser scraping service (is it more hassle than its worth?)

Comments
8 min read
Optimizing Browser Fingerprint Spoofing and Session Validation in Automated Scrapers

Optimizing Browser Fingerprint Spoofing and Session Validation in Automated Scrapers

1
Comments
2 min read
Data Normalization Across Dublin Rental Portals: How to Make Listings Comparable

Data Normalization Across Dublin Rental Portals: How to Make Listings Comparable

Comments
4 min read
Robots.txt Is Not Enough Anymore: What Developers Need to Know About AI Crawler Controls

Robots.txt Is Not Enough Anymore: What Developers Need to Know About AI Crawler Controls

Comments
6 min read
How to Build Token-Efficient Web Scraping Pipelines for AI Agents Using n8n

How to Build Token-Efficient Web Scraping Pipelines for AI Agents Using n8n

Comments
7 min read
SiteRows example #1:

SiteRows example #1:

Comments
1 min read
How to Build a Web Scraper with Node.js and Puppeteer in 8 Simple Steps

How to Build a Web Scraper with Node.js and Puppeteer in 8 Simple Steps

Comments
8 min read
Why Your Requests + BeautifulSoup Stack Will Fail in Production

Why Your Requests + BeautifulSoup Stack Will Fail in Production

Comments
4 min read
Optimizing Stealth Browser Fingerprint Integrity and Session Auth

Optimizing Stealth Browser Fingerprint Integrity and Session Auth

Comments
1 min read
Why Real Browser Automation Is Replacing Simple HTTP Scraping

Why Real Browser Automation Is Replacing Simple HTTP Scraping

Comments
7 min read
PHP cURL Timeout Error: CONNECTTIMEOUT vs TIMEOUT (With Working Examples)

PHP cURL Timeout Error: CONNECTTIMEOUT vs TIMEOUT (With Working Examples)

Comments
1 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.