ATP: Adaptive Tensor Parallelism for Foundation Models.

Shenggan Cheng Ziming Liu Jiangsu Du Yang You

Published in: CoRR (2023)

Keyphrases

probabilistic model
statistical models
parameter estimation
computational power
data sets
neural network
machine learning
information retrieval
learning algorithm
social networks
bayesian networks
artificial neural networks
higher order
model selection
automated theorem proving