Accelerating large-scale distributed neural network training with SPMD parallelism.

Shiwei Zhang Lansong Diao Chuan Wu Siyu Wang Wei Lin

Published in: SoCC (2022)

Keyphrases

neural network training
neural network
training algorithm
distributed systems
parallel execution
parallel processing
machine learning
optimization method
data sets
decision making
semi supervised
back propagation
massively parallel