DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Why Reddit Blocked Unauthenticated JSON in 2026 (and How to Still Get Reddit Data)

Why Reddit Blocked Unauthenticated JSON in 2026 (and How to Still Get Reddit Data)

Comments
8 min read
Building Reliable Web Access for AI Agents: Search, Crawl, Markdown, and Screenshots

Building Reliable Web Access for AI Agents: Search, Crawl, Markdown, and Screenshots

Comments
3 min read
Replacing Fragile CSS Selectors with LLM-Powered Zero-Shot JSON Extraction

Replacing Fragile CSS Selectors with LLM-Powered Zero-Shot JSON Extraction

Comments
8 min read
Querying Germany's Company Register via API: Clean JSON and the new eGbR

Querying Germany's Company Register via API: Clean JSON and the new eGbR

Comments
1 min read
Best AI Web Scraping Tools in 2026: How to Choose

Best AI Web Scraping Tools in 2026: How to Choose

Comments
9 min read
Playwright + Proxies: Sticky Sessions, Rotation, and the SOCKS5 Trap

Playwright + Proxies: Sticky Sessions, Rotation, and the SOCKS5 Trap

Comments 1
3 min read
I built an open-source browser agent that turns any website into structured JSON

I built an open-source browser agent that turns any website into structured JSON

1
Comments 1
6 min read
Residential Proxies for Developers: Picking the Right IP Strategy (2026 Comparison)

Residential Proxies for Developers: Picking the Right IP Strategy (2026 Comparison)

1
Comments
5 min read
How to Scrape Public Telegram Channels Without the API, Login, or MTProto

How to Scrape Public Telegram Channels Without the API, Login, or MTProto

Comments
3 min read
How to Scrape the Facebook Ad Library for Competitor Ad Intelligence (No Login)

How to Scrape the Facebook Ad Library for Competitor Ad Intelligence (No Login)

Comments
3 min read
Found a gap in the bookkeeping automation chain

Found a gap in the bookkeeping automation chain

1
Comments 1
1 min read
We Sent 10,000 Requests Through a Residential Proxy Network. Here's the Raw Data.

We Sent 10,000 Requests Through a Residential Proxy Network. Here's the Raw Data.

Comments
3 min read
Build a Healthcare Lead List From the Public NPI Registry (NPPES API)

Build a Healthcare Lead List From the Public NPI Registry (NPPES API)

Comments
3 min read
How We Optimized a Django Playwright Scraper to Save 60% on Rotating Proxy Bandwidth

How We Optimized a Django Playwright Scraper to Save 60% on Rotating Proxy Bandwidth

Comments
4 min read
Diagnosing Cloudflare Blocks Before Changing Your Scraper

Diagnosing Cloudflare Blocks Before Changing Your Scraper

2
Comments 3
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.