Gsyn: Reducing Staleness and Communication Waiting via Grouping-based Synchronization for Distributed Deep Learning.
Yijun LiJiawei HuangZhaoyi LiJingling LiuShengwen ZhouWanchun JiangJianxin WangPublished in: INFOCOM (2024)
Keyphrases
- deep learning
- interprocess communication
- concurrent processes
- unsupervised learning
- unsupervised feature learning
- restricted boltzmann machine
- machine learning
- mental models
- supervised learning
- natural language processing
- co occurrence
- dimensionality reduction
- natural language
- learning strategies
- multiscale
- deep architectures
- computer vision
- data sets