DEV Community

Cover image for Foundations of probability (1)
Aya Ebrahim
Aya Ebrahim

Posted on

Foundations of probability (1)

As explained before in our previous blog that probabilities is essential to explore more in the data science field So, Let's start our today's journey!


You may wonder what is probability and its role in data science field?
Probability is the foundation of many models and methods in data science, We can't really build a good model without knowing the concepts of probabilities.


Flipping a coin

Do you remember "head and tail" we were taught in the primary school? We'll travel back years ago to this basic example.
As we know we explain and also show the theoretical part in a piece of code in python.

Bernoulli trial
Possible outcomes here are binary which can be modeled as (Yes/No) or (On/Off) or (Head/Tail) or (Success/Failure) and so on.
In our case its success (Heads) or Failures (Tails).
Each outcome is called an Event.
For a fair coin flip it we have 50% chance of getting heads and 50% chance of getting tails for each event.

Let's simulate the coin flips, We'll be using the "Bernoulli" object from a python library called "Scipy.stats".

#Generate rvs for random variates using arg. p for success prob. and size for no. of coin flips.
from scipy.stats import bernoulli
bernoulli.rvs(p=0.5, size=1)

Enter fullscreen mode Exit fullscreen mode

Outputs =>
array([0]) is the output for the first time which means failure or T.
array([1]) is the output if you ran it again which means success or H.


Flipping multiple coins

Change the size of flips

bernoulli.rvs (p=0.5, size=10)
Enter fullscreen mode Exit fullscreen mode

Output => array([0, 1, 1, 0, 1, 0, 1, 0, 1, 0])
So, How many head there? Let's explore this together!

sum(bernoulli.rvs(p=0.5, size=10))
Enter fullscreen mode Exit fullscreen mode

Output => 5, This means 5 heads and 5 tails.
Let's rerun it again and see what happens.

sum((bernoulli.rvs(p=0.5, size=10)))
Enter fullscreen mode Exit fullscreen mode

Output => 2, This means we have 2 heads and 8 tails.

Using binomial distribution for independent Bernoulli trials

  1. n => No. of the coin flips
  2. p => Probability of success
  3. size => No. of draws of the same experiment

Let's simulate the coin flips, We'll be using the "Binom" object from a python library called "Scipy.stats".

#**Binomial r.v.**
from scipy.stats import binom
binom.rvs (n=10 , p = 0.5 , size = 1)
Enter fullscreen mode Exit fullscreen mode

Output => array([7]), This means we have 7 heads out of 10 flips.
Let's now try 10 more times of drawing.

binom.rvs(n=10, p=0.5 , size=10) 
Enter fullscreen mode Exit fullscreen mode

Output => array([6, 5, 6, 6, 7, 6, 4, 6, 5, 6]), This means that "6" is the result that repeats the most for a fair coin.

Biased coin draws

binom.rvs(n=10, p=0.3 , size=10)
Enter fullscreen mode Exit fullscreen mode

Output => array([2, 5, 3, 4, 2, 4, 1, 4, 2, 5]), Changed the p of getting heads to "0.3" lead to different outcomes.

Random number generator seed

  • To simulate the outcome of a random experiment.
  • If you run the same command with the same random seed, you will always get the same result. In Python we need to set a seed for the generator to produce similar outcomes in each experiment. Then we can check if the results are what we expected. We have two options to configure the generator: using the (random_state) parameter of the rvs function or using (np.random.seed).
from scipy.stats import binom
binom.rvs(n=10, p=0.5 , size =1, random_state=42)
Enter fullscreen mode Exit fullscreen mode

Or

from scipy.stats import binom
import numpy as np
np.random.seed(42)
binom.rvs(n=10,p=0.5,size=1)
Enter fullscreen mode Exit fullscreen mode

Output => array([4])


Today's blog is done but let's do a practice now!

Practice

This exercise requires the bernoulli object from the scipy.stats library to simulate the two possible outcomes from a coin flip, 1 ("heads") or 0 ("tails"), and the numpy library (loaded as np) to set the random generator seed.

We'll use the bernoulli.rvs() function to simulate coin flips using the size argument.

We will set the random seed so you can reproduce the results for the random experiment in each exercise.

From each experiment, you will get the values of each coin flip. You can add the coin flips to get the number of heads after flipping 10 coins using the sum() function.

Steps:

Import bernoulli from scipy.stats, set the seed with np.random.seed(). Simulate 1 flip, with a 35% chance of heads.
Use bernoulli.rvs() and sum() to get the number of heads after 10 coin flips with 35% chance of getting heads.
Using bernoulli.rvs() and sum(), try to get the number of heads after 5 flips with a 50% chance of getting heads.

# Import numpy
import numpy as np
# Import the bernoulli object from scipy.stats
from scipy.stats import bernoulli

# Set the random seed to reproduce the results
np.random.seed(42)

# Simulate one coin flip with 35% chance of getting heads
coin_flip = bernoulli.rvs(p=0.35, size=10)
print(coin_flip)
Enter fullscreen mode Exit fullscreen mode

Output => [0 1 1 0 0 0 0 1 0 1]

#Using bernoulli.rvs() and sum(), try to get the number of heads after 5 flips with a 50% chance of getting heads.
five_coin_flips = bernoulli.rvs(p=0.5, size=5)
coin_flips_sum = sum(five_coin_flips)
print(coin_flips_sum)
Enter fullscreen mode Exit fullscreen mode

Output => 2

Using binom to flip even more coins Previously, you simulated 10 coin flips with a 35% chance of getting heads using bernoulli.rvs().

This exercise loads the binom object from scipy.stats so you can use binom.rvs() to simulate 20 trials of 10 coin flips with a 35% chance of getting heads on each coin flip.

#Defining binom
# Set the random seed to reproduce the results
np.random.seed(42)

# Simulate 20 trials of 10 coin flips 
draws = binom.rvs(n=10, p=0.35, size=20)
print(draws)
Enter fullscreen mode Exit fullscreen mode

Output => [3 6 4 4 2 2 1 5 4 4 1 6 5 2 2 2 3 4 3 3]


I hope you got some basic knowledge and refreshed your mind with this blog and see you in the next learning journey where we will learn the probability distribution and more!
You can check the code
Resource : https://campus.datacamp.com/courses/foundations-of-probability-in-python/

Oldest comments (0)