On the Convergence of Step Decay Step-Size for Stochastic Optimization.
Xiaoyu WangSindri MagnússonMikael JohanssonPublished in: NeurIPS (2021)
Keyphrases
- step size
- stochastic optimization
- convergence rate
- convergence speed
- faster convergence
- variable step size
- line search
- cost function
- multistage
- global convergence
- steepest descent method
- post processing
- stochastic gradient descent
- primal dual
- blind source separation
- gradient method
- neural network
- quantization step
- robust optimization
- artificial intelligence
- objective function
- linear programming
- image compression
- differential evolution
- wavelet coefficients