On the Convergence of (Stochastic) Gradient Descent with Extrapolation for Non-Convex Minimization.
Yi XuZhuoning YuanSen YangRong JinTianbao YangPublished in: IJCAI (2019)
Keyphrases
- convex minimization
- stochastic gradient descent
- global convergence
- step size
- convergence rate
- convergence speed
- global optimum
- loss function
- least squares
- matrix factorization
- optimization methods
- random forests
- multiple kernel learning
- support vector machine
- weight vector
- online algorithms
- machine learning
- decision trees
- particle swarm
- regularization parameter
- optimization method
- support vector
- learning rate
- ensemble methods
- differential evolution
- linear combination
- model selection
- particle swarm optimization
- evolutionary algorithm
- search space