PACL: Piecewise Arc Cotangent Decay Learning Rate for Deep Neural Network Training.

Haixu Yang Jihong Liu Hongwei Sun Henggui Zhang

Published in: IEEE Access (2020)

Keyphrases

learning rate
neural network training
training algorithm
hidden layer
learning algorithm
convergence rate
neural network
convergence speed
adaptive learning rate
weight vector
rapid convergence
multilayer neural networks
optimization method
control parameters
delta bar delta
support vector machine