C
search
search
reviewers
reviewers
feeds
feeds
assignments
assignments
settings
logout
ZeRO++: Extremely Efficient Collective Communication for Giant Model Training.
Guanhua Wang
Heyang Qin
Sam Ade Jacobs
Connor Holmes
Samyam Rajbhandari
Olatunji Ruwase
Feng Yan
Lei Yang
Yuxiong He
Published in:
CoRR (2023)
Keyphrases
</>
computational model
similarity measure
probabilistic model
high level
objective function
formal model
mathematical model
conceptual model
data sets
cost function
probability distribution
statistical model
communication networks