Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
aicrawlers
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Meta's AI Crawler Scraped My Site 7.9 Million Times: How I Survived 900+ GB of Bandwidth Chaos
Arkaprabha Banerjee
Arkaprabha Banerjee
Arkaprabha Banerjee
Follow
Apr 7
Meta's AI Crawler Scraped My Site 7.9 Million Times: How I Survived 900+ GB of Bandwidth Chaos
#
aicrawlers
#
serveroptimization
#
webscraping
#
bandwidthmanagement
Comments
Add Comment
3 min read
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account
