Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
webscraping
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Lessons Learned: Dealing With Instagram Rate Limits and Blocks (and Why I Switched to a Hosted API)
stoned
stoned
stoned
Follow
Jun 1
Lessons Learned: Dealing With Instagram Rate Limits and Blocks (and Why I Switched to a Hosted API)
#
webdev
#
python
#
webscraping
#
api
1
 reaction
Comments
Add Comment
2 min read
Your Scraper Returned a Clean Row. It Was Wrong.
Alex Spinov
Alex Spinov
Alex Spinov
Follow
Jun 1
Your Scraper Returned a Clean Row. It Was Wrong.
#
webscraping
#
python
#
ai
#
llm
Comments
Add Comment
10 min read
The compiler caught a lot. It didn't catch enough.
John Rooney
John Rooney
John Rooney
Follow
for
Extract by Zyte
May 31
The compiler caught a lot. It didn't catch enough.
#
rust
#
programming
#
webscraping
#
zyte
Comments
Add Comment
8 min read
How to Handle JavaScript-Rendered Pages Without a Full Browser
John Rooney
John Rooney
John Rooney
Follow
for
Extract by Zyte
May 31
How to Handle JavaScript-Rendered Pages Without a Full Browser
#
webscraping
#
python
#
zyte
#
programming
Comments
Add Comment
5 min read
Scraping Paginated Sites Without Getting It Wrong
John Rooney
John Rooney
John Rooney
Follow
for
Extract by Zyte
May 31
Scraping Paginated Sites Without Getting It Wrong
#
webscraping
#
python
#
zyte
#
programming
Comments
Add Comment
6 min read
How to Store What You Scrape (Without Making a Mess)
John Rooney
John Rooney
John Rooney
Follow
for
Extract by Zyte
May 31
How to Store What You Scrape (Without Making a Mess)
#
webscraping
#
python
#
zyte
#
progrmaming
Comments
Add Comment
5 min read
Why Your Scraper Works in the Browser But Fails in Python
John Rooney
John Rooney
John Rooney
Follow
for
Extract by Zyte
May 31
Why Your Scraper Works in the Browser But Fails in Python
#
webscraping
#
python
#
zyte
#
programming
Comments
Add Comment
7 min read
How to Scrape RedNote (Xiaohongshu) Without Coding
Gary Lee
Gary Lee
Gary Lee
Follow
Jun 1
How to Scrape RedNote (Xiaohongshu) Without Coding
#
automation
#
socialmedia
#
tutorial
#
webscraping
Comments
Add Comment
4 min read
How to monitor a brand across 5 Chinese social platforms with Python in 2026 — the cross-platform dedup problem and how to handle it
Sami
Sami
Sami
Follow
May 31
How to monitor a brand across 5 Chinese social platforms with Python in 2026 — the cross-platform dedup problem and how to handle it
#
china
#
webscraping
#
python
#
datascience
Comments
Add Comment
4 min read
Bing Search API Replacement: scrape SERP results for $1.05/1K
Devil Scrapes
Devil Scrapes
Devil Scrapes
Follow
May 31
Bing Search API Replacement: scrape SERP results for $1.05/1K
#
webscraping
#
python
#
apify
#
seo
Comments
Add Comment
7 min read
Google AI Overview Tracker: 8-selector battery + citation drift telemetry
Devil Scrapes
Devil Scrapes
Devil Scrapes
Follow
May 31
Google AI Overview Tracker: 8-selector battery + citation drift telemetry
#
webscraping
#
seo
#
python
#
apify
Comments
Add Comment
8 min read
How to Scrape Reddit Without the API (After the 2023 Price Changes)
Omar Eldeeb
Omar Eldeeb
Omar Eldeeb
Follow
May 31
How to Scrape Reddit Without the API (After the 2023 Price Changes)
#
webscraping
#
python
#
api
#
datascience
Comments
Add Comment
6 min read
A free proxy list that's actually checked (HTTP/SOCKS4/SOCKS5, updated every 30 min)
Billy
Billy
Billy
Follow
Jul 4
A free proxy list that's actually checked (HTTP/SOCKS4/SOCKS5, updated every 30 min)
#
proxy
#
python
#
webscraping
#
opensource
Comments
Add Comment
2 min read
Rotating proxies for Scrapy, Playwright and requests — one small library
Billy
Billy
Billy
Follow
Jul 4
Rotating proxies for Scrapy, Playwright and requests — one small library
#
python
#
webscraping
#
scrapy
#
proxy
Comments
Add Comment
3 min read
Equity Crowdfunding Leads: scrape 4,800+ Wefunder founders for $5/1K
Devil Scrapes
Devil Scrapes
Devil Scrapes
Follow
May 31
Equity Crowdfunding Leads: scrape 4,800+ Wefunder founders for $5/1K
#
webscraping
#
python
#
apify
#
data
Comments
Add Comment
7 min read
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account