Stochastic Normalized Gradient Descent with Momentum for Large Batch Training.

Shen-Yi Zhao Yin-Peng Xie Wu-Jun Li

Published in: CoRR (2020)

Keyphrases

learning rate
batch mode
training phase
training set
cost function
error function
real time
stochastic programming
training samples
loss function
training process
quality prediction
database
stochastic optimization
incremental learning
online learning
case study
genetic algorithm