Login / Signup
ZeRO++: Extremely Efficient Collective Communication for Large Model Training.
Guanhua Wang
Heyang Qin
Sam Ade Jacobs
Xiaoxia Wu
Connor Holmes
Zhewei Yao
Samyam Rajbhandari
Olatunji Ruwase
Feng Yan
Lei Yang
Yuxiong He
Published in:
ICLR (2024)
Keyphrases
</>
probabilistic model
mathematical model
data sets
information retrieval
high level
computational model
statistical model
simulation model
machine learning
genetic algorithm
probability distribution
experimental data
test data
conceptual model
linear model