Login / Signup
Automated Tensor Model Parallelism with Overlapped Communication for Efficient Foundation Model Training.
Shengwei Li
Zhiquan Lai
Yanqi Hao
Weijie Liu
Keshi Ge
Xiaoge Deng
Dongsheng Li
Kai Lu
Published in:
CoRR (2023)
Keyphrases
</>
probabilistic model
computational model
mathematical model
theoretical foundation
prior knowledge
management system
theoretical analysis
neural network
decision making
cost function
d objects
semi supervised
supervised learning
theoretical framework
statistical model
experimental data