Nesterov's accelerated gradient and momentum as approximations to regularised update descent.

Aleksandar Botev Guy Lever David Barber

Published in: IJCNN (2017)

Keyphrases

semidefinite programming
learning rate
neural network
closed form
sensitivity analysis
genetic algorithm
edge detection
linear programming
image gradient
approximation methods
convex concave