ZeRO-infinity: breaking the GPU memory wall for extreme scale deep learning.

Samyam Rajbhandari Olatunji Ruwase Jeff Rasley Shaden Smith Yuxiong He

Published in: SC (2021)

Keyphrases

deep learning
unsupervised learning
unsupervised feature learning
machine learning
mental models
weakly supervised
data sets
viewpoint
deep belief networks
data mining
learning algorithm
computer vision
image segmentation
pattern recognition
co occurrence
restricted boltzmann machine