Sequence Parallelism: Long Sequence Training from System Perspective.

Shenggui Li Fuzhao Xue Chaitanya Baranwal Yongbin Li Yang You

Published in: ACL (1) (2023)

Keyphrases

training set
training phase
supervised learning
parallel computation
data sets
viewpoint
online learning
training process
genetic algorithm
e learning
training examples
test set
parallel computing
feedforward neural networks
parallel computers