Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
webscraping
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Playwright + Proxies: Sticky Sessions, Rotation, and the SOCKS5 Trap
RoamProxy
RoamProxy
RoamProxy
Follow
Jul 18
Playwright + Proxies: Sticky Sessions, Rotation, and the SOCKS5 Trap
#
webscraping
#
playwright
#
python
#
tutorial
Comments
Add Comment
3 min read
I built an open-source browser agent that turns any website into structured JSON
Krishna shakula
Krishna shakula
Krishna shakula
Follow
Jun 18
I built an open-source browser agent that turns any website into structured JSON
#
ai
#
python
#
opensource
#
webscraping
1
 reaction
Comments
1
 comment
6 min read
Residential Proxies for Developers: Picking the Right IP Strategy (2026 Comparison)
danielk_automat
danielk_automat
danielk_automat
Follow
Jul 7
Residential Proxies for Developers: Picking the Right IP Strategy (2026 Comparison)
#
webscraping
#
proxies
#
python
#
automation
1
 reaction
Comments
Add Comment
5 min read
How to Build a Threads Scraper for Meta Profiles and Posts
Omar Eldeeb
Omar Eldeeb
Omar Eldeeb
Follow
Jun 13
How to Build a Threads Scraper for Meta Profiles and Posts
#
api
#
webscraping
#
socialmedia
#
datascience
Comments
Add Comment
6 min read
How to Build a LinkedIn Profile Scraper: The Honest Technical Guide
Omar Eldeeb
Omar Eldeeb
Omar Eldeeb
Follow
Jun 13
How to Build a LinkedIn Profile Scraper: The Honest Technical Guide
#
api
#
webscraping
#
datascience
#
leadgen
Comments
Add Comment
7 min read
How to Scrape Public Telegram Channels Without the API, Login, or MTProto
Perufitlife
Perufitlife
Perufitlife
Follow
Jun 12
How to Scrape Public Telegram Channels Without the API, Login, or MTProto
#
webscraping
#
telegram
#
javascript
#
osint
Comments
Add Comment
3 min read
How to Scrape the Facebook Ad Library for Competitor Ad Intelligence (No Login)
Perufitlife
Perufitlife
Perufitlife
Follow
Jun 12
How to Scrape the Facebook Ad Library for Competitor Ad Intelligence (No Login)
#
webscraping
#
marketing
#
facebook
#
ai
Comments
Add Comment
3 min read
Found a gap in the bookkeeping automation chain
Richard Smith
Richard Smith
Richard Smith
Follow
Jul 5
Found a gap in the bookkeeping automation chain
#
discuss
#
automation
#
fintech
#
webscraping
1
 reaction
Comments
1
 comment
1 min read
We Sent 10,000 Requests Through a Residential Proxy Network. Here's the Raw Data.
RoamProxy
RoamProxy
RoamProxy
Follow
Jul 16
We Sent 10,000 Requests Through a Residential Proxy Network. Here's the Raw Data.
#
webscraping
#
api
#
testing
#
datascience
Comments
Add Comment
3 min read
Build a Healthcare Lead List From the Public NPI Registry (NPPES API)
Perufitlife
Perufitlife
Perufitlife
Follow
Jun 12
Build a Healthcare Lead List From the Public NPI Registry (NPPES API)
#
webscraping
#
leadgeneration
#
healthcare
#
api
Comments
Add Comment
3 min read
How We Optimized a Django Playwright Scraper to Save 60% on Rotating Proxy Bandwidth
proxyvero
proxyvero
proxyvero
Follow
Jun 11
How We Optimized a Django Playwright Scraper to Save 60% on Rotating Proxy Bandwidth
#
python
#
django
#
webscraping
#
playwright
Comments
Add Comment
4 min read
Diagnosing Cloudflare Blocks Before Changing Your Scraper
Anakin
Anakin
Anakin
Follow
Jul 14
Diagnosing Cloudflare Blocks Before Changing Your Scraper
#
webscraping
#
automation
#
cloudflare
#
playwright
2
 reactions
Comments
3
 comments
4 min read
How Paywalls Actually Work: The Engineering Behind Them
Tony Wang
Tony Wang
Tony Wang
Follow
Jun 11
How Paywalls Actually Work: The Engineering Behind Them
#
webscraping
#
seo
#
webdev
#
tutorial
2
 reactions
Comments
Add Comment
14 min read
Why Cloudflare Breaks Proxy-Only Scrapers
Anakin
Anakin
Anakin
Follow
Jun 10
Why Cloudflare Breaks Proxy-Only Scrapers
#
webscraping
#
cloudflare
#
python
#
automation
Comments
Add Comment
4 min read
Residential vs. Datacenter Proxies: Which One Do You Actually Need?
RoamProxy
RoamProxy
RoamProxy
Follow
Jul 14
Residential vs. Datacenter Proxies: Which One Do You Actually Need?
#
webscraping
#
python
#
api
#
tutorial
Comments
Add Comment
3 min read
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account