Login / Signup
Learning Rate Perturbation: A Generic Plugin of Learning Rate Schedule towards Flatter Local Minima.
Hengyu Liu
Qiang Fu
Lun Du
Tiancheng Zhang
Ge Yu
Shi Han
Dongmei Zhang
Published in:
CoRR (2022)
Keyphrases
</>
learning rate
learning algorithm
convergence rate
convergence speed
error function
hidden layer
rapid convergence
scheduling problem
adaptive learning rate
activation function
multilayer neural networks
natural gradient
weight vector
bp neural network algorithm
simulated annealing
np hard
cost function
pairwise