Diffusion Approximations for the Constant Step Size Backpropagation Algorithm and Resistance to Local Minima.
William FinnoffPublished in: NIPS (1992)
Keyphrases
- step size
- backpropagation algorithm
- learning rate
- convergence rate
- back propagation
- convergence speed
- feedforward neural networks
- neural network
- multilayer perceptron
- backpropagation learning algorithm
- hidden layer
- diffusion approximations
- cost function
- feed forward neural networks
- activation function
- multi layer perceptron
- heavy traffic
- queueing networks
- feed forward
- simulated annealing
- artificial neural networks
- decision making
- dynamic programming
- arrival rate
- long run
- pattern recognition
- fuzzy logic
- recurrent neural networks