Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

What is the difference between back-propagation and feed-forward Neural Network?

What is the difference between back-propagation and feed-forward neural networks?

By googling and reading, I found that in feed-forward there is only forward direction, but in back-propagation once we need to do a forward-propagation and then back-propagation. I referred to this link

  1. Any other difference other than the direction of flow? What about the weight calculation? The outcome?
  2. Say I am implementing back-propagation, i.e. it contains forward and backward flow. So is back-propagation enough for showing feed-forward?
like image 593
Unmesha Sreeveni U.B Avatar asked Feb 09 '15 06:02

Unmesha Sreeveni U.B


People also ask

What is the relationship between feed forward network and backpropagation?

The backpropagation algorithm performs learning on a multilayer feed-forward neural network. It iteratively learns a set of weights for prediction of the class label of tuples. A multilayer feed-forward neural network consists of an input layer, one or more hidden layers, and an output layer.

What do you understand about backpropagation in feedforward neural networks?

Technically, the backpropagation algorithm is a method for training the weights in a multilayer feed-forward neural network. As such, it requires a network structure to be defined of one or more layers where one layer is fully connected to the next layer.

What is the difference between feed forward neural networks and CNNS?

A convolutional neural net is a structured neural net where the first several layers are sparsely connected in order to process information (usually visual). A feed forward network is defined as having no cycles contained within it. If it has cycles, it is a recurrent neural network.

What is feed forward in neural networks?

A feedforward neural network is a type of artificial neural network in which nodes' connections do not form a loop. Often referred to as a multi-layered network of neurons, feedforward neural networks are so named because all information flows in a forward manner only.


1 Answers

  • A Feed-Forward Neural Network is a type of Neural Network architecture where the connections are "fed forward", i.e. do not form cycles (like in recurrent nets).

  • The term "Feed forward" is also used when you input something at the input layer and it travels from input to hidden and from hidden to output layer.
    The values are "fed forward".

Both of these uses of the phrase "feed forward" are in a context that has nothing to do with training per se.

  • Backpropagation is a training algorithm consisting of 2 steps: 1) Feed forward the values 2) calculate the error and propagate it back to the earlier layers. So to be precise, forward-propagation is part of the backpropagation algorithm but comes before back-propagating.
like image 62
runDOSrun Avatar answered Oct 01 '22 13:10

runDOSrun