AdaGossip: Adaptive Consensus Step-size for Decentralized Deep Learning with Communication Compression.
Sai Aparna AketiAbolfazl HashemiKaushik RoyPublished in: CoRR (2024)
Keyphrases
- step size
- deep learning
- variable step size
- convergence rate
- cost function
- convergence speed
- unsupervised feature learning
- machine learning
- unsupervised learning
- mental models
- blind source separation
- image compression
- model selection
- weakly supervised
- wavelet coefficients
- neural network
- non stationary
- optimization algorithm
- pattern recognition
- data mining