A DNN Optimizer that Improves over AdaBelief by Suppression of the Adaptive Stepsize Range.
Guoqiang ZhangKenta NiwaW. Bastiaan KleijnPublished in: Trans. Mach. Learn. Res. (2023)
Keyphrases
- step size
- variable step size
- approximate dynamic programming
- convergence speed
- convergence rate
- cost function
- temporal difference
- faster convergence
- optimization algorithm
- query optimization
- training data
- image quality
- wavelet coefficients
- face recognition
- multi objective
- optimal solution
- training process
- reinforcement learning
- hessian matrix
- search direction