RedSync: Reducing synchronization bandwidth for distributed deep learning training system.
Jiarui FangHaohuan FuGuangwen YangCho-Jui HsiehPublished in: J. Parallel Distributed Comput. (2019)
Keyphrases
- deep learning
- deep architectures
- restricted boltzmann machine
- unsupervised learning
- unsupervised feature learning
- deep belief networks
- machine learning
- training examples
- training set
- supervised learning
- higher order
- domain specific
- text classification
- probabilistic model
- training samples
- weakly supervised
- viewpoint
- high dimensional
- bayesian networks
- data sets