Python web scraping tutorial

Sometimes you need to do some data mining for a project and you just don't know how to start. Especially if you are new to web scraping you may be struggling to figure our which programming language to use.

Which libraries are available to you etc. Well web scraping is actually quite a big field. There are many languages which will be able to achieve it. However some easier than others. In my opinion for any newbie trying to start with web scraping. Python is the goto language for this as it has a rich set of libraries for everything from doing HTTP requests, launching a selenium instance and more. If you are interested in learning about python web scraping. Why not check out this tutorial I wrote a 6000 word blog post on the topic here:

https://generalistprogrammer.com/python/python-web-scraping-tutorial-with-beautifulsoup-and-requests/

Comments

[villival]

useful tutorial i end up with this
DeprecationWarning: should_run_async will not call transform_cell automatically in the future. Please pass the result to transformed_cell argument and any exception that happen during thetransform in preprocessing_exc_tuple in IPython 7.17 and above.
and should_run_async(code)