DEV Community

loading...

Discussion on: Secure your Data API from Web Scrapers

Collapse
sonyarianto profile image
Sony AK

nice post, I think nowdays is very easy to scrape with many API-centric websites, JS things etc, even the AMP initiative also make page easier to scrape.

Collapse
mxldevs profile image
MxL Devs Author

Thanks for the feedback. It's interesting to see how the web has changed and what kind of trends become popular. I hadn't heard of AMP before (besides seeing it appear in the URL when I read news on google lol) but that would probably be a good example of how scraping can be used to make it easier to share data. RSS is cool for example but not everyone wants to bother with that kind of thing.

Collapse
sonyarianto profile image
Sony AK

yes yes, totally agree with that, RSS is cool and WebSub make it cooler. Back to AMP, I think AMP is good initiative for user (in the name of speed) and also good for Google because it's easier to scrape clean content for their indexing purpose hahahahah

Thread Thread
kremnari profile image
Nick Smith

Bringing up Google and AMP is interesting, because they both effectively are scrapers. I wonder if you could test Anti-Scraper measures against AMP conversion?