Sparse maximal update parameterization: A holistic approach to sparse training dynamics.

Nolan Dey Shane Bergsma Joel Hestness

Published in: CoRR (2024)

Keyphrases

sparse data
sparse representation
training set
high dimensional
data sets
search engine
social networks
case study
multiscale
artificial neural networks
multi class
image classification
training examples
test set
training algorithm
compressed sensing