DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Playwright + Proxies: Sticky Sessions, Rotation, and the SOCKS5 Trap

Playwright + Proxies: Sticky Sessions, Rotation, and the SOCKS5 Trap

Comments
3 min read
I built an open-source browser agent that turns any website into structured JSON

I built an open-source browser agent that turns any website into structured JSON

1
Comments 1
6 min read
Residential Proxies for Developers: Picking the Right IP Strategy (2026 Comparison)

Residential Proxies for Developers: Picking the Right IP Strategy (2026 Comparison)

1
Comments
5 min read
How to Build a Threads Scraper for Meta Profiles and Posts

How to Build a Threads Scraper for Meta Profiles and Posts

Comments
6 min read
How to Build a LinkedIn Profile Scraper: The Honest Technical Guide

How to Build a LinkedIn Profile Scraper: The Honest Technical Guide

Comments
7 min read
How to Scrape Public Telegram Channels Without the API, Login, or MTProto

How to Scrape Public Telegram Channels Without the API, Login, or MTProto

Comments
3 min read
How to Scrape the Facebook Ad Library for Competitor Ad Intelligence (No Login)

How to Scrape the Facebook Ad Library for Competitor Ad Intelligence (No Login)

Comments
3 min read
Found a gap in the bookkeeping automation chain

Found a gap in the bookkeeping automation chain

1
Comments 1
1 min read
We Sent 10,000 Requests Through a Residential Proxy Network. Here's the Raw Data.

We Sent 10,000 Requests Through a Residential Proxy Network. Here's the Raw Data.

Comments
3 min read
Build a Healthcare Lead List From the Public NPI Registry (NPPES API)

Build a Healthcare Lead List From the Public NPI Registry (NPPES API)

Comments
3 min read
How We Optimized a Django Playwright Scraper to Save 60% on Rotating Proxy Bandwidth

How We Optimized a Django Playwright Scraper to Save 60% on Rotating Proxy Bandwidth

Comments
4 min read
Diagnosing Cloudflare Blocks Before Changing Your Scraper

Diagnosing Cloudflare Blocks Before Changing Your Scraper

2
Comments 3
4 min read
How Paywalls Actually Work: The Engineering Behind Them

How Paywalls Actually Work: The Engineering Behind Them

2
Comments
14 min read
Why Cloudflare Breaks Proxy-Only Scrapers

Why Cloudflare Breaks Proxy-Only Scrapers

Comments
4 min read
Residential vs. Datacenter Proxies: Which One Do You Actually Need?

Residential vs. Datacenter Proxies: Which One Do You Actually Need?

Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.