DEV Community

daud99
daud99

Posted on • Updated on

Perceptron

Perceptron Model

You can think of it as a basis of neural network. The motivation for perceptron is taken from the human neuron.

Image description

Input are going to neuron which perform some sort of computation on it in order to give the output. The functionality inside the neuron is often referred as Activation Function.

Now, in order to do the learning we need to adjust some parameters these parameters are known as weights. These weights get multiplied to the input.

Image description

There is still a problem. What if the input is zero? Doesn't matter what change we do to the w nothing is going to happen. In order to solve this problem we will add a bias to each input.

Image description

The interesting thing is the multiplication of input and it's weight has to overcome the bias in order to have some effect on the output.

The value of both the weight and bias can be positive and negative.

Mathematically our generalisation is

Image description

Top comments (0)