On the Relationship Between the OpenAI Evolution Strategy and Stochastic Gradient Descent.
Xingwen ZhangJeff CluneKenneth O. StanleyPublished in: CoRR (2017)
Keyphrases
- stochastic gradient descent
- evolution strategy
- least squares
- evolutionary algorithm
- step size
- matrix factorization
- loss function
- differential evolution
- random forests
- support vector machine
- convergence speed
- genetic algorithm
- weight vector
- regularization parameter
- online algorithms
- optimization methods
- global search
- multiple kernel learning
- simulated annealing
- multi objective
- feature selection
- markov chain
- collaborative filtering
- decision trees
- particle swarm optimization algorithm
- importance sampling
- image restoration
- optimization algorithm
- particle swarm optimization
- online learning
- cost function
- feature extraction
- learning algorithm