Empirically Explaining SGD from a Line Search Perspective.

Maximus Mutschler Andreas Zell

Published in: ICANN (2) (2021)

Keyphrases

line search
step size
quadratic programming
objective function
convergence rate
risk minimization
conjugate gradient
primal dual
global convergence
linear program
optimization procedure
artificial neural networks
linear programming
convergence speed
machine learning
learning rate
genetic algorithm