DEV Community

# webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
The Modern Social Media Automation and Stealth Architecture Guide

The Modern Social Media Automation and Stealth Architecture Guide

Comments
12 min read
I built a competitor pricing monitor in 3 days, here's how it actually works

I built a competitor pricing monitor in 3 days, here's how it actually works

Comments
2 min read
How I Built a 12-Tool MCP Server for AI Agents in 4 Hours (and What It Taught Me About 2026 Scraping)

How I Built a 12-Tool MCP Server for AI Agents in 4 Hours (and What It Taught Me About 2026 Scraping)

Comments
4 min read
The easiest Chinese platform to scrape in Python in 2026: Bilibili in under 30 lines

The easiest Chinese platform to scrape in Python in 2026: Bilibili in under 30 lines

Comments
6 min read
How to scrape RedNote (Xiaohongshu) with Python in 2026 — the auth/signing problem and how to handle it

How to scrape RedNote (Xiaohongshu) with Python in 2026 — the auth/signing problem and how to handle it

Comments
9 min read
Event-Driven Scraping vs Cron Jobs: What Actually Works at Scale

Event-Driven Scraping vs Cron Jobs: What Actually Works at Scale

Comments
5 min read
The Apify Actor Execution Lifecycle: 8 Decision Engines

The Apify Actor Execution Lifecycle: 8 Decision Engines

Comments
18 min read
How Proxy Rotation Fails When Your TLS Fingerprint Is Wrong

How Proxy Rotation Fails When Your TLS Fingerprint Is Wrong

Comments
3 min read
Monitoring the Chinese Social Media Ecosystem: RedNote, Weibo & Bilibili Data Pipeline

Monitoring the Chinese Social Media Ecosystem: RedNote, Weibo & Bilibili Data Pipeline

Comments
5 min read
Building a Lightweight Media Downloader with Modern Web Techniques (Pinterest Case Study)

Building a Lightweight Media Downloader with Modern Web Techniques (Pinterest Case Study)

Comments
3 min read
Building an End-to-End Amazon Movers & Shakers Data Pipeline: Engineering Guide from Real-Time Crawling to Automated Alerting

Building an End-to-End Amazon Movers & Shakers Data Pipeline: Engineering Guide from Real-Time Crawling to Automated Alerting

5
Comments
5 min read
Why JSON Schema Validation Isn't Enough for Apify Actors

Why JSON Schema Validation Isn't Enough for Apify Actors

1
Comments
18 min read
Selenium keeps getting blocked by Cloudflare? Here's what the fingerprint actually catches (and how to stop triggering it)

Selenium keeps getting blocked by Cloudflare? Here's what the fingerprint actually catches (and how to stop triggering it)

Comments
3 min read
Why your scraper plateaus at 5-6 concurrent Chrome instances (and the shared-cookie trap nobody names)

Why your scraper plateaus at 5-6 concurrent Chrome instances (and the shared-cookie trap nobody names)

Comments
4 min read
Facebook scrambles author names with Flexbox order — here's the 5-line diagnostic that proves it isn't custom fonts

Facebook scrambles author names with Flexbox order — here's the 5-line diagnostic that proves it isn't custom fonts

Comments
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.