Sync-Switch: Hybrid Parameter Synchronization for Distributed Deep Learning.

Shijian Li Oren Mangoubi Lijie Xu Tian Guo

Published in: ICDCS (2021)

Keyphrases

deep learning
unsupervised learning
unsupervised feature learning
machine learning
deep architectures
weakly supervised
mental models
restricted boltzmann machine
decision trees
multiscale
probabilistic model