Quasi-Global Momentum: Accelerating Decentralized Deep Learning on Heterogeneous Data.
Tao LinSai Praneeth KarimireddySebastian U. StichMartin JaggiPublished in: CoRR (2021)
Keyphrases
- deep learning
- heterogeneous data
- data integration
- unsupervised learning
- unsupervised feature learning
- data sources
- data management
- metadata
- machine learning
- databases
- weakly supervised
- mental models
- information sources
- data mining
- complex data
- web data
- expectation maximization
- maximum likelihood
- pattern recognition
- reinforcement learning
- training data
- computer vision