DEV Community


Discussion on: How to Create a Web Crawler From Scratch in Python

fprime profile image
Frankie Author

Since there has been a lot of confusion about the curl issue I have updated the post to address the reason and possible workarounds.

hossain000 profile image

That code was awesome. In this code you have extracted meta description, can you show how to extract <div class , PLEASE

Some comments have been hidden by the post's author - find out more