Incorporating the Barzilai-Borwein Adaptive Step Size into Sugradient Methods for Deep Network Training.

Antonio Robles-Kelly Asef Nazari

Published in: DICTA (2019)

Keyphrases

step size
cost function
optimization methods
convergence speed
gradient method
stochastic gradient descent
multiscale
recursive least squares
variable step size