ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning.

Samyam Rajbhandari Olatunji Ruwase Jeff Rasley Shaden Smith Yuxiong He

Published in: CoRR (2021)

Keyphrases

deep learning
unsupervised learning
machine learning
unsupervised feature learning
mental models
weakly supervised
restricted boltzmann machine
deep architectures
data sets
image processing
multiscale
information extraction
multi class
supervised learning
co occurrence
superpixels