DEV Community

#webscraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Building Reliable Web Access for AI Agents: Search, Crawl, Markdown, and Screenshots
kun_shen_eedb57cc827955f5 profile

Building Reliable Web Access for AI Agents: Search, Crawl, Markdown, and Screenshots

#webscraping
Comments
3 min read
Replacing Fragile CSS Selectors with LLM-Powered Zero-Shot JSON Extraction
alterlab profile

Replacing Fragile CSS Selectors with LLM-Powered Zero-Shot JSON Extraction

#webscraping #aiagents #llm #python
Comments
8 min read
Querying Germany's Company Register via API: Clean JSON and the new eGbR
pat198707 profile

Querying Germany's Company Register via API: Clean JSON and the new eGbR

#api #data #dataengineering #webscraping
Comments
1 min read
Best AI Web Scraping Tools in 2026: How to Choose
tonywangca profile

Best AI Web Scraping Tools in 2026: How to Choose

#ai #tutorial #webscraping
Comments
9 min read
Playwright + Proxies: Sticky Sessions, Rotation, and the SOCKS5 Trap
roamproxy profile

Playwright + Proxies: Sticky Sessions, Rotation, and the SOCKS5 Trap

#webscraping #playwright #python #tutorial
Comments
3 min read
I built an open-source browser agent that turns any website into structured JSON
krishna_kittu_1d2837d30bb profile

I built an open-source browser agent that turns any website into structured JSON

#ai #python #opensource #webscraping
1
Comments 1
6 min read
Residential Proxies for Developers: Picking the Right IP Strategy (2026 Comparison)
danielk_automat profile

Residential Proxies for Developers: Picking the Right IP Strategy (2026 Comparison)

#webscraping #proxies #python #automation
1
Comments
5 min read
How to Scrape the Facebook Ad Library for Competitor Ad Intelligence (No Login)
perufitlife profile

How to Scrape the Facebook Ad Library for Competitor Ad Intelligence (No Login)

#webscraping #marketing #facebook #ai
Comments
3 min read
How to Scrape Public Telegram Channels Without the API, Login, or MTProto
perufitlife profile

How to Scrape Public Telegram Channels Without the API, Login, or MTProto

#webscraping #telegram #javascript #osint
Comments
3 min read
Found a gap in the bookkeeping automation chain
richard_smith_154156d471ef profile

Found a gap in the bookkeeping automation chain

#discuss #automation #fintech #webscraping
1
Comments 1
1 min read
We Sent 10,000 Requests Through a Residential Proxy Network. Here's the Raw Data.
roamproxy profile

We Sent 10,000 Requests Through a Residential Proxy Network. Here's the Raw Data.

#webscraping #api #testing #datascience
Comments
3 min read
Build a Healthcare Lead List From the Public NPI Registry (NPPES API)
perufitlife profile

Build a Healthcare Lead List From the Public NPI Registry (NPPES API)

#webscraping #leadgeneration #healthcare #api
Comments
3 min read
How We Optimized a Django Playwright Scraper to Save 60% on Rotating Proxy Bandwidth
proxyvero profile

How We Optimized a Django Playwright Scraper to Save 60% on Rotating Proxy Bandwidth

#python #django #webscraping #playwright
Comments
4 min read
Diagnosing Cloudflare Blocks Before Changing Your Scraper
anakin_writers profile

Diagnosing Cloudflare Blocks Before Changing Your Scraper

#webscraping #automation #cloudflare #playwright
2
Comments 3
4 min read
How Paywalls Actually Work: The Engineering Behind Them
tonywangca profile

How Paywalls Actually Work: The Engineering Behind Them

#webscraping #seo #webdev #tutorial
2
Comments
14 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.