The Heavy-Tail Phenomenon in SGD.

Mert Gürbüzbalaban Umut Simsekli Lingjiong Zhu

Published in: CoRR (2020)

Keyphrases

stochastic gradient descent
neural network
genetic algorithm
image processing
feature extraction
lower bound
evolutionary algorithm
multiresolution
hidden markov models
probability distribution
particle swarm optimization
heavy tailed