ps-CALR: Periodic-Shift Cosine Annealing Learning Rate for Deep Neural Networks.
Olanrewaju Victor JohnsonXin Ying ChewKhai Wah KhawMing Ha LeePublished in: IEEE Access (2023)
Keyphrases
- learning rate
- neural network
- activation function
- hidden layer
- backpropagation algorithm
- training algorithm
- convergence rate
- error function
- learning algorithm
- adaptive learning rate
- rapid convergence
- fuzzy neural network
- convergence speed
- simulated annealing
- basis functions
- back propagation
- weight update
- multilayer neural networks
- feed forward neural networks
- feedforward neural networks
- euclidean distance
- feature vectors
- weight vector
- fuzzy logic
- artificial neural networks
- training speed
- neural network model
- convergence theorem
- linear combination
- neural nets
- feed forward
- delta bar delta
- multi layer perceptron
- metaheuristic
- pairwise
- genetic algorithm