An Adaptive Learning Rate Deep Learning Optimizer Using Long and Short-Term Gradients Based on G-L Fractional-Order Derivative.
Shuang ChenChanglun ZhangHaibing MuPublished in: Neural Process. Lett. (2024)
Keyphrases
- short term
- learning rate
- deep learning
- fractional order
- long term
- learning algorithm
- differential equations
- feedback control
- unsupervised learning
- convergence rate
- hidden layer
- pid controller
- convergence speed
- machine learning
- transfer function
- differential evolution
- dynamical systems
- optimization algorithm
- closed loop
- mental models
- optimal control
- expert systems
- control system
- zero crossing
- multiscale
- higher order
- supervised learning