Adaptive Compression for Communication-Efficient Distributed Training.
Maksim MakarenkoElnur GasanovAbdurakhmon SadievRustem IslamovPeter RichtárikPublished in: Trans. Mach. Learn. Res. (2023)
Keyphrases
- data compression
- communication overhead
- distributed systems
- communication systems
- lightweight
- communication cost
- spatially distributed
- distributed control
- load balance
- training process
- sensor networks
- cooperative
- distributed environment
- load balancing
- training examples
- online learning
- training phase
- hidden markov models
- open systems
- multiresolution
- distributed network
- global knowledge
- data sets