DEV Community

Discussion on: Scraping every post on an Instagram profile with less than 10 lines of Python

Collapse
 
chrisgreening profile image
Chris Greening

Unfortunately it's an incredibly slow approach, Instagram starts blocking if you scrape too much too fast so I try to play the long game and let it run in the background.

In the scrape_posts function, you'll see pause=10 which refers to a 10s pause between each post scrape. Considering you have 552 posts, that'll be (552*10)/60 = 92 minutes 😬

In the future, passing silent=False as an argument will print what number the scrape is currently on, I'm actually gonna edit that in right now for anyone else reading the article in the future!

Thanks for reaching out!