Unintended Effects on Adaptive Learning Rate for Training Neural Network with Output Scale Change.

Ryuichi Kanoh Mahito Sugiyama

Published in: CoRR (2021)

Keyphrases

adaptive learning rate
neural network
learning rate
globally convergent
training algorithm
convergence rate
genetic algorithm
learning algorithm
artificial neural networks
hidden layer
image restoration
back propagation
convex optimization
convergence speed
feed forward neural networks
autocalibration