Login / Signup
Optimus-CC: Efficient Large NLP Model Training with 3D Parallelism Aware Communication Compression.
Jaeyong Song
Jinkyu Yim
Jaewon Jung
Hongsun Jang
Hyung-Jin Kim
Youngsok Kim
Jinho Lee
Published in:
CoRR (2023)
Keyphrases
</>
computational model
probabilistic model
experimental data
high level
probability distribution
text mining
mathematical model
data sets
neural network
artificial intelligence
multi agent
cost function
natural language processing
question answering