DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
instagrapi vs HikerAPI: Which Instagram API Approach Actually Works for Automation?

instagrapi vs HikerAPI: Which Instagram API Approach Actually Works for Automation?

1
Comments
3 min read
We Tried to Beat Cloudflare With Proxies and TLS Tricks. Here's What Actually Failed.

We Tried to Beat Cloudflare With Proxies and TLS Tricks. Here's What Actually Failed.

3
Comments
3 min read
Practical Web Scraping in Python: Playwright, Scrapy, and Where They Meet

Practical Web Scraping in Python: Playwright, Scrapy, and Where They Meet

Comments 2
3 min read
How I killed my fragile Instagram scraper and collapsed data collection into one API call

How I killed my fragile Instagram scraper and collapsed data collection into one API call

Comments
1 min read
From Crawler Chaos to Official API: How We Rebuilt Our Cross-Border E-Commerce Backend

From Crawler Chaos to Official API: How We Rebuilt Our Cross-Border E-Commerce Backend

Comments
2 min read
WAFER Deep Crawler: 8-Layer Stealth Architecture - Fingerprint Layer

WAFER Deep Crawler: 8-Layer Stealth Architecture - Fingerprint Layer

5
Comments
3 min read
Web Scraping with Playwright: Handle Any Website

Web Scraping with Playwright: Handle Any Website

1
Comments
4 min read
Heroku Is Getting Expensive: A 2026 Cost Calculator + Migration Guide

Heroku Is Getting Expensive: A 2026 Cost Calculator + Migration Guide

1
Comments 1
13 min read
How to Collect Product Data from a Website with Python

How to Collect Product Data from a Website with Python

Comments
3 min read
I Built a Tool to Track Which World Cup Players Are Blowing Up on Social Media

I Built a Tool to Track Which World Cup Players Are Blowing Up on Social Media

1
Comments
3 min read
5 lessons from 5 interviews on AI agents and web scraping

5 lessons from 5 interviews on AI agents and web scraping

Comments 2
5 min read
Anti bot protection

Anti bot protection

Comments
1 min read
How to Get Amazon Review & Rating Data at Scale (and What's Actually Public in 2026)

How to Get Amazon Review & Rating Data at Scale (and What's Actually Public in 2026)

2
Comments
3 min read
Your proxy connected. That doesn't mean it hid your IP.

Your proxy connected. That doesn't mean it hid your IP.

1
Comments
4 min read
I built a tool that checks whether ChatGPT recommends your brand (Python + Apify)

I built a tool that checks whether ChatGPT recommends your brand (Python + Apify)

2
Comments 1
7 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.