DEV Community

Cover image for Web Scraping using axios and Cheerio

Web Scraping using axios and Cheerio

Abayomi Ogunnusi on October 09, 2021

Hello folks, today I will be sharing information on Web Scraping. Web scraping is simply the process of extracting content and data from a website....
Collapse
 
rahulpar profile image
Rahul Parakkat

Thanks for putting this together Abayomi.

Collapse
 
drsimplegraffiti profile image
Abayomi Ogunnusi

I am glad you found it useful

Collapse
 
pastuh profile image
pastuh

For dynamic content this not works :)

Collapse
 
sadevapp profile image
sadevapp

try to use selenium webdriver, this will work perfectly

Collapse
 
drsimplegraffiti profile image
Abayomi Ogunnusi

Thanks for your contribution

Collapse
 
anatugreen profile image
Anaturuchi

Hi, please how did this come about: require('dotenv').config()?
It is giving me error of module not found

Collapse
 
drsimplegraffiti profile image
Abayomi Ogunnusi

You will install it. npm install dotenv

Collapse
 
anatugreen profile image
Anaturuchi

Thanks Abayomi.

Thread Thread
 
drsimplegraffiti profile image
Abayomi Ogunnusi

You are welcome

Collapse
 
minhhunghuynh1106 profile image
igdev • Edited

How can I get data in the next page if that page has pagination? Thanks for your article!

Collapse
 
drsimplegraffiti profile image
Abayomi Ogunnusi

Thanks for the feedback will read on it