A Stochastic Proximal Polyak Step Size.
Fabian SchaippRobert M. GowerMichael UlbrichPublished in: Trans. Mach. Learn. Res. (2023)
Keyphrases
- step size
- convergence rate
- convergence speed
- cost function
- evolutionary programming
- faster convergence
- hessian matrix
- line search
- stochastic gradient descent
- monte carlo
- steepest descent method
- wavelet coefficients
- gradient method
- adaptive filter
- differential evolution
- wavelet transform
- multiresolution
- learning algorithm
- neural network