There are two perspectives (at least) in every web scraping story: one of the website being scraped and the other of the scraper itself. In this article, we’ll talk about this relationship using a specific example. On one side, there’s Bax Shop, a website selling and renting musical equipment. On the other, there’s Price2Spy – an advanced web crawler, looking to monitor prices on Bax Shop.
We’ll start off by talking about how Bax Shop came to be and give you a glimpse into its roots. Then we’ll focus on the period when they first launched their online store and how initially they fought bots on their website. Afterward, we’ll go over other methods they employed and also cover how Price2Spy adapted to these defenses, in this back-and-forth game of price monitoring.
To read the rest of the article follow the link: https://botmenot.com/blog/how-bax-shop-fights-bots/
Top comments (1)
Hi there, we encourage authors to share their entire posts here on DEV, rather than mostly pointing to an external link. Doing so helps ensure that readers don’t have to jump around to too many different pages, and it helps focus the conversation right here in the comments section.
If you choose to do so, you also have the option to add a canonical URL directly to your post.