DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Your analytics dashboard is blind to most AI traffic. Here's how I fixed mine.

Your analytics dashboard is blind to most AI traffic. Here's how I fixed mine.

Comments
4 min read
Your Scraper Works Locally but Returns 403 on a Server. Here's Why.

Your Scraper Works Locally but Returns 403 on a Server. Here's Why.

Comments
11 min read
How to Scrape Any Shopify Store and Get Structured Product Data

How to Scrape Any Shopify Store and Get Structured Product Data

Comments
3 min read
The Real Alternative Data Edge Isn't the Data — It's the Pipeline

The Real Alternative Data Edge Isn't the Data — It's the Pipeline

Comments
6 min read
instagrapi vs HikerAPI: Which Instagram API Approach Actually Works for Automation?

instagrapi vs HikerAPI: Which Instagram API Approach Actually Works for Automation?

1
Comments
3 min read
We Tried to Beat Cloudflare With Proxies and TLS Tricks. Here's What Actually Failed.

We Tried to Beat Cloudflare With Proxies and TLS Tricks. Here's What Actually Failed.

3
Comments
3 min read
Practical Web Scraping in Python: Playwright, Scrapy, and Where They Meet

Practical Web Scraping in Python: Playwright, Scrapy, and Where They Meet

Comments 2
3 min read
Give Your AI Agent a Web Scraper, Not Just a Browser

Give Your AI Agent a Web Scraper, Not Just a Browser

7
Comments 2
4 min read
How I killed my fragile Instagram scraper and collapsed data collection into one API call

How I killed my fragile Instagram scraper and collapsed data collection into one API call

Comments
1 min read
WAFER Deep Crawler: 8-Layer Stealth Architecture - Fingerprint Layer

WAFER Deep Crawler: 8-Layer Stealth Architecture - Fingerprint Layer

5
Comments
3 min read
Web Scraping with Playwright: Handle Any Website

Web Scraping with Playwright: Handle Any Website

1
Comments
4 min read
Heroku Is Getting Expensive: A 2026 Cost Calculator + Migration Guide

Heroku Is Getting Expensive: A 2026 Cost Calculator + Migration Guide

1
Comments 1
13 min read
How to Collect Product Data from a Website with Python

How to Collect Product Data from a Website with Python

1
Comments
3 min read
I Built a Tool to Track Which World Cup Players Are Blowing Up on Social Media

I Built a Tool to Track Which World Cup Players Are Blowing Up on Social Media

1
Comments
3 min read
5 lessons from 5 interviews on AI agents and web scraping

5 lessons from 5 interviews on AI agents and web scraping

Comments 2
5 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.