Automatic Learning Rate Maximization in Large Adaptive Machines.

Yann LeCun Patrice Y. Simard Barak A. Pearlmutter

Published in: NIPS (1992)

Keyphrases

learning rate
convergence rate
learning algorithm
convergence speed
error function
hidden layer
rapid convergence
adaptive learning rate
multilayer neural networks
objective function
weight vector
training algorithm
activation function
delta bar delta
control parameters
natural gradient
linear program