Inefficiency of K-FAC for Large Batch Size Training.

Linjian Ma Gabe Montague Jiayu Ye Zhewei Yao Amir Gholami Kurt Keutzer Michael W. Mahoney

Published in: AAAI (2020)

Keyphrases

batch size
batch mode
incremental learning
poisson process
training process
single item
batch processing
special case
machine learning
bayesian networks
steady state