Evaluation of MPI Allreduce for Distributed Training of Convolutional Neural Networks.
Adrián CastellóMar CatalánManuel F. DolzJosé I. MestreEnrique S. Quintana-OrtíJosé DuatoPublished in: PDP (2021)
Keyphrases
- convolutional neural networks
- distributed systems
- parallel algorithm
- training set
- cooperative
- lightweight
- multi agent
- distributed data
- training examples
- neural network
- communication cost
- training process
- training algorithm
- distributed environment
- training phase
- parallel computing
- evaluation metrics
- training samples
- peer to peer
- general purpose