Incremental PID Controller-Based Learning Rate Scheduler for Stochastic Gradient Descent.
Zenghui WangJun ZhangPublished in: IEEE Trans. Neural Networks Learn. Syst. (2024)
Keyphrases
- learning rate
- stochastic gradient descent
- pid controller
- weight vector
- delta bar delta
- step size
- convergence rate
- convergence speed
- particle swarm optimization
- control system
- control method
- closed loop
- pso algorithm
- control scheme
- learning algorithm
- fuzzy control
- least squares
- rbf neural network
- matrix factorization
- hidden layer
- loss function
- training algorithm
- rapid convergence
- bp neural network
- multiple kernel learning
- online algorithms
- support vector machine
- model selection
- regularization parameter
- particle swarm optimization pso