Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Why do weight parameters of logistic regression get initialized to zeros?

I have seen the weights of neural networks initialized to random numbers so I am curious why the weights of logistic regression get initialized to zeros?

like image 784
Alaa Awad Avatar asked Sep 10 '17 14:09

Alaa Awad


1 Answers

Incase of Neural Networks there n neurons in each layer. So if you initialize weight of each neuron with 0 then after back propogation each of them will have same weights :

shallow neural network

Neurons a1 and a2 in the first layer will have same weights no matter how long you iterate. Since they are calculating the same function.

Which is not the case with logistic regression its simply y = Wx + b.

like image 148
Mudits Avatar answered Oct 25 '22 14:10

Mudits