adaQN: An Adaptive Quasi-Newton Algorithm for Training RNNs.

Nitish Shirish Keskar Albert S. Berahas

Published in: CoRR (2015)

Keyphrases

neural network training
dynamic programming
cost function
learning algorithm
optimal solution
quasi newton
search space
np hard
simulated annealing
optimization algorithm
least squares
objective function
worst case
convergence rate
training process