Sequence Parallelism: Making 4D Parallelism Possible.

Shenggui Li Fuzhao Xue Yongbin Li Yang You

Published in: CoRR (2021)

Keyphrases

parallel processing
parallel computation
data sets
parallel execution
shared memory
massively parallel
real time
neural network
genetic algorithm
artificial intelligence
three dimensional
database systems
digital libraries
parallel computers
parallel architectures
data parallelism