DEV Community

Discussion on: BeautifulSoup is so 2000-and-late: Web Scraping in 2020

Collapse
 
mohiuddinsumon profile image
Mohiuddin Sumon

Yes it's true bs4 does have a lot of methods and knowing and remembering them is tough but for most of the work we can simply use common ones.

However where I faced most difficulty is with dynamic pages for example you can go to an ecommerce site and scrape a search result page.

In this type of scenario how would gazpacho work ? @maxhumber maybe you can make a tutorial video with selenium and gazpacho ?

Collapse
 
maxhumber profile image
Max Humber

There's some examples of gazpacho + selenium on this website: scrape.world/