Understanding Approximate Fisher Information for Fast Convergence of Natural Gradient Descent in Wide Neural Networks.

Ryo Karakida Kazuki Osawa

Published in: NeurIPS (2020)

Keyphrases

fisher information
neural network
information geometry
cost function
pattern recognition
positive definite
probability density function
euclidean space
convergence rate
vector space