Adaptive Learning Rate via Covariance Matrix Based Preconditioning for Deep Neural Networks.

Yasutoshi Ida Yasuhiro Fujiwara Sotetsu Iwamura

Published in: IJCAI (2017)

Keyphrases

covariance matrix
neural network
adaptive learning rate
covariance matrices
learning rate
principal component analysis
back propagation
sample size
training algorithm
computer vision
conjugate gradient
genetic algorithm
objective function