Statistical Hypothesis Test in Python

D VAMSIDHAR — Fri, 04 Nov 2022 10:16:25 +0000

What is Statistical Hypothesis Test?

In statistics, hypothesis test is used to test the quality of an assumption. By this test we can interpret whether the assumption made is true to factual data and situation or violates the facts.
This test is called STATISTICAL HYPOTHESIS TESTING.

Currently there are hundreds of statistical hypothesis testing but in this post we are going to see few of them which are most used.

Following is the flowchart that describes the types which we will discuss in this post :

1. NORMALITY TEST

This statistical test helps you check whether your data has Gaussian Distribution or not.

This test again has 3 different types in it :

1.1 Shapiro-Wilk Test

Python code for this test :

# Example of the Shapiro-Wilk Normality Test
from scipy.stats import shapiro
data = [0.873, 2.817, 0.121, -0.945, -0.055, -1.436, 0.360, -1.478, -1.637, -1.869]
stat, p = shapiro(data)
print('stat=%.3f, p=%.3f' % (stat, p))
if p > 0.05:
    print('Probably Gaussian')
else:
    print('Probably not Gaussian')

1.2 D Agostino's K^2 Test

Python code for this test :

# Example of the D'Agostino's K^2 Normality Test
from scipy.stats import normaltest
data = [0.873, 2.817, 0.121, -0.945, -0.055, -1.436, 0.360, -1.478, -1.637, -1.869]
stat, p = normaltest(data)
print('stat=%.3f, p=%.3f' % (stat, p))
if p > 0.05:
    print('Probably Gaussian')
else:
    print('Probably not Gaussian')

1.3 Anderson-Darling Test

Python code for the test :

# Example of the Anderson-Darling Normality Test
from scipy.stats import anderson
data = [0.873, 2.817, 0.121, -0.945, -0.055, -1.436, 0.360, -1.478, -1.637, -1.869]
result = anderson(data)
print('stat=%.3f' % (result.statistic))
for i in range(len(result.critical_values)):
    sl, cv = result.significance_level[i], result.critical_values[i]
    if result.statistic < cv:
        print('Probably Gaussian at the %.1f%% level' % (sl))
    else:
        print('Probably not Gaussian at the %.1f%% level' % (sl))

Python codes about other tests shall be discussed in upcoming posts.

To be continued ....

Useful Python Modules

D VAMSIDHAR — Tue, 18 Oct 2022 11:04:34 +0000

Python is a language used vastly across many domains or technical fields like data science, web development, automation etc. Being used on such a large scale we discover many new modules present and used in python. In this article, you will come across various modules in python used in different fields be it research or software building.

Fields which require python modules :

Data Science
GUI Development
Game Development
Web Development
Automation
Network automation/programming

First of all what are python modules ?

A python module is collection of different runnable codes, python statements and definitions. Grouping related code into a module makes the code easier to understand and use. It also makes the code logically organized, in short it reduces the amount of work to be done and also the complexity and lines of code.

Following are different types of Fields using different python modules along with their respective pip installation statement.

Most used modules in DATA SCIENCE

Numpy -

pip install numpy

-> NumPy aims to use of array object to save and use the data which faster than traditional python lists.

Pandas -

pip install pandas

-> Pandas module aims to data manipulation and importing the data into the respective workspace.

Scipy -

pip install scipy

Matplotlib -

pip install matplotlib

-> Matplotlib aims to visualization of the data imported in the form of line graphs, scatter plots, histograms etc.

Sci-kit Learn -

pip install scikit-learn

Seaborn -

pip install seaborn

Most used modules in GUI development

PyQt5 -

pip install PyQt5

Tkinter - The Tkinter library is built-in with every Python installation.
Kivy -

pip install Kivy

Dear PyGui -

pip install dearpygui

PySide2 -

pip install PySide2

Most used modules in Game Development

Pygame -

pip install pygame

Pyglet -

pip install pyglet

Panda 3D -

pip install Panda3D

pykyra -

pip install pykira

Ursina -

pip install ursina

Python is used to build backend in web development where you can deploy your machine learning models and make amazingly interactive and useful.
Most used modules in Web Development

Django -

pip install django

Cherry Py -

pip install CherryPy

Flask -

pip install Flask

Battle
Web2py -

pip install web2py

Most used modules in Network Automation

Netmiko -

pip install netmiko

NAPALM -

pip install napalm

Genie -

pip install genie

NCClient -

pip install ncclient

Paramiko -

pip install paramiko

Most used modules in Automation

Py auto GUI -

pip install PyAutoGUI

pywinauto -

pip install pywinauto

Selenium -

pip install selenium

Requests -

pip install requests

Beautifulsoup -

pip install beautifulsoup4

DEV Community: D VAMSIDHAR

Statistical Hypothesis Test in Python

What is Statistical Hypothesis Test?

1. NORMALITY TEST

Useful Python Modules