Efficient MPI-AllReduce for large-scale deep learning on GPU-clusters.

Truong Thao Nguyen Mohamed Wahib Ryousei Takano

Published in: Concurr. Comput. Pract. Exp. (2021)

Keyphrases

deep learning
machine learning
clustering algorithm
parallel implementation
parallel algorithm
parallel programming
parallel architectures
parallel computing
weakly supervised
text mining
online learning
message passing