On Convergence-Diagnostic based Step Sizes for Stochastic Gradient Descent.

Scott Pesme Aymeric Dieuleveut Nicolas Flammarion

Published in: CoRR (2020)

Keyphrases

step size
stochastic gradient descent
convergence rate
convergence speed
faster convergence
learning rate
cost function
differential evolution
particle swarm optimization
multi objective
computer vision
feature selection
decision trees