DEV Community

Cover image for Web Scraping using axios and Cheerio

Web Scraping using axios and Cheerio

DrSimple on October 09, 2021

Hello folks, today I will be sharing information on Web Scraping. Web scraping is simply the process of extracting content and data from a website....
Collapse
 
rahulpar profile image
Rahul Parakkat •

Thanks for putting this together Abayomi.

Collapse
 
drsimplegraffiti profile image
DrSimple •

I am glad you found it useful

Collapse
 
pastuh profile image
pastuh •

For dynamic content this not works :)

Collapse
 
sadevapp profile image
sadevapp •

try to use selenium webdriver, this will work perfectly

Collapse
 
drsimplegraffiti profile image
DrSimple •

Thanks for your contribution

Collapse
 
anatugreen profile image
Anaturuchi •

Hi, please how did this come about: require('dotenv').config()?
It is giving me error of module not found

Collapse
 
drsimplegraffiti profile image
DrSimple •

You will install it. npm install dotenv

Collapse
 
anatugreen profile image
Anaturuchi •

Thanks Abayomi.

Thread Thread
 
drsimplegraffiti profile image
DrSimple •

You are welcome

Collapse
 
drsimplegraffiti profile image
DrSimple •

Thanks for the feedback will read on it

Collapse
 
minhhunghuynh1106 profile image
igdev • • Edited

How can I get data in the next page if that page has pagination? Thanks for your article!