Generalized Polyak Step Size for First Order Optimization with Momentum.
Xiaoyu WangMikael JohanssonTong ZhangPublished in: ICML (2023)
Keyphrases
- step size
- faster convergence
- steepest descent method
- line search
- stochastic gradient descent
- convergence rate
- cost function
- convergence speed
- evolutionary programming
- optimization algorithm
- learning rate
- optimization method
- differential evolution
- global optimization
- hessian matrix
- global convergence
- variable step size
- global optimum
- optimization problems
- gradient method
- wavelet coefficients
- adaptive filter
- optimization methods
- genetic programming
- quantization step
- multi objective
- image processing