DEV Community

loading...

Discussion on: How to Create a Web Crawler From Scratch in Python

Collapse
fprime profile image
Frankie Author

Since there has been a lot of confusion about the curl issue I have updated the post to address the reason and possible workarounds.

Collapse
hossain000 profile image
Hossain000

That code was awesome. In this code you have extracted meta description, can you show how to extract <div class , PLEASE

Some comments have been hidden by the post's author - find out more