The Proxy Step-size Technique for Regularized Optimization on the Sphere Manifold.
Fang BaiAdrien BartoliPublished in: CoRR (2022)
Keyphrases
- step size
- faster convergence
- steepest descent method
- stochastic gradient
- stochastic gradient descent
- line search
- convergence rate
- convergence speed
- cost function
- risk minimization
- global optimization
- quantization step
- hessian matrix
- objective function
- global convergence
- wavelet coefficients
- artificial neural networks
- neural network
- variable step size
- optimization methods
- gradient method
- low dimensional
- optimization problems
- least squares
- adaptive filter
- feature space