Priority-based Parameter Propagation for Distributed DNN Training.
Anand JayarajanJinliang WeiGarth GibsonAlexandra FedorovaGennady PekhimenkoPublished in: MLSys (2019)
Keyphrases
- training process
- distributed systems
- training algorithm
- parameter values
- distributed network
- cooperative
- distributed environment
- lightweight
- distributed data
- test set
- training examples
- online learning
- peer to peer
- supervised learning
- web services
- mobile agents
- training set
- multi agent
- reinforcement learning
- case study
- communication overhead
- decision trees