Adapting the Learning Rate of the Learning Rate in Hypergradient Descent.

Kazuma Itakura Kyohei Atarashi Satoshi Oyama Masahito Kurihara

Published in: SCIS/ISIS (2020)

Keyphrases

learning rate
convergence rate
learning algorithm
error function
convergence speed
hidden layer
multilayer neural networks
adaptive learning rate
training algorithm
rapid convergence
natural gradient
activation function
neural network
optimization algorithm
convergence theorem