Evolutionary Stochastic Gradient Descent for Optimization of Deep Neural Networks.
Xiaodong CuiWei ZhangZoltán TüskeMichael PichenyPublished in: NeurIPS (2018)
Keyphrases
- stochastic gradient descent
- stochastic gradient
- neural network
- loss function
- least squares
- step size
- matrix factorization
- genetic algorithm
- random forests
- weight vector
- optimization algorithm
- regularization parameter
- importance sampling
- online algorithms
- support vector machine
- global optimization
- multiple kernel learning
- ensemble methods
- online learning
- cost function
- machine learning