TL;DR
In this article, I’ll give you the ultimate Python libraries for any Machine Learning project:
- the must-know libraries for each step of the machine learning cycle - EDA, data cleaning, data engineering, modeling, etc…
- all open source
- all python
Full application
1. 🚀Taipy
Let's start by talking about something that is often overlooked- actually making your model accessible and useful.
Taipy will do just that, and bring your Machine Learning model to the next level.
It is an open-source library designed for easy development for both front-end (GUI) and your ML/Data pipeline(s). No other knowledge is required (no CSS, no nothing!). It has been designed to expedite application development, from initial prototypes to production-ready applications.
Taipy ensures your ML model can move into a full-fledged pilot and application that will impress your end-users.
We're almost at 1000 stars and couldn't do this without you🙏
EDA, Data Cleaning and Data Engineering
2.🐼Pandas
How to code in Python without knowing Pandas?
This library has two core data structures: dataframes and series, allowing fast and flexible data cleaning and preparation. Essential functions include:
- Loading data
- Reshaping dataframes
- Basic statistics Pandas is the tool to start your Datascience project. Other concurrents are trying to surpass Pandas but are not as widely used as Dask or Polars. A good subject for a future article!
3.🌱Numpy
Although lower level than Pandas, Numpy is an essential tool for scientific computing and data preprocessing.
It evolves around arrays and allows for fast data manipulation and maths functions.
This library is another must-know Python library and, like Pandas is a must-have library for data-centric tasks.
4.🔢Statsmodel
True to its name, this library provides functions for statistical analysis.
The array of capabilities ranges from descriptive analysis to statistical tests; it is also a great library for handling time series data, univariate and multivariate statistics, etc.
5.👓YData Profiling
YData Profiling facilitates the EDA step by thoroughly analyzing your data in one line of code.
The analysis includes missing value detection, correlation, and distribution analysis, etc.
This tool is very user-friendly and straightforward, making it an easy addition to your data science toolbox.
Machine Learning/ Deep Learning Algorithm
6.💼 Scikit-learn
This might be Python’s top 3 most famous libraries, and rightfully so.
Sklearn is a reference in Machine Learning. It includes different models such as K-means clustering, regression, and classification algorithms.
It also excels in dimension reduction techniques.
Sklearn also provides data selection and validation functions. It's easy to learn/use and should be your go-to ML library during your data science journey.
7.🧠 Keras
Keras is a high-level API that runs on top of frameworks such as TensorFlow. If starting with Neural Networks, start with Keras. It is ideal for quick implementations as it simplifies the implementation process, making it the best beginner-friendly option for Neural Network implementation.
8.🧠💪TensorFlow
This library is a must-know for Neural Network modeling. Perfect when dealing with unstructured data such as image classification or NLP (Natural Language Processing). TensorFlow is widely used in research and industries as it provides a complete API for the design and manipulation of Neural Networks. Keras (mentioned above) provides a higher-level (simpler) API (It is built on top of TensorFlow).
9.🌴XGBoost
XGBoost is one of the most popular libraries regarding Machine Learning algorithms.
This gradient-boosting library is widely used in real-life use cases, particularly for tabular data.
It is a favorite among Kaggle competition winners.
This library includes regression and classification algorithms but also provides feature selection tools.
10.🐈CatBoost
This library, standing for Categorical Boosting, is the way to go if your dataset predominantly consists of categorical data. This library will circumvent the complexity of one hot encoding, eliminating the need to preprocess categorical data. It can provide better accuracy than XGBoost when running with default parameters.
Hope you enjoyed this article!
I’m a rookie writer and would welcome any suggestions for improvement!
Feel free to reach out if you have any questions.
Top comments (13)
Awesome! I did not know the first one. My pure ML list:
ML
I have not started with time series nor CI/CD in ML 😋
That's a great list, will definitely take time to look into some I don't know like Skrub or poniard. Thanks for sharing!
Here's a bonus one: Here's a bonus one: github.com/confident-ai/deepeval
This sounds really good, thanks for sharing!
Thanks for providing this awesome list! 🎉
Taipy link points to CatBoost )
Updated, thank you!
Hey, thanks Marine for this clear article :)
Great ML list!
Thank you for sharing!
Nice list! Thanks for sharing
Python is great
Great article Marine ! I want to get into machine learning, this is definitely helpful, thxxx 👍🏼🙌🏼
Love it, thank you for your article!