Differentiable Self-Adaptive Learning Rate.

Bozhou Chen Hongzhi Wang Chenmin Ba

Published in: CoRR (2022)

Keyphrases

learning rate
control parameters
learning algorithm
convergence rate
hidden layer
error function
objective function
rapid convergence
loss function
convergence speed
activation function
training algorithm
adaptive learning rate
natural gradient
multilayer neural networks
weight vector
training set