Birder: Communication-Efficient 1-bit Adaptive Optimizer for Practical Distributed DNN Training.
Hanyang PengShuang QinYue YuJin WangHui WangGe LiPublished in: NeurIPS (2023)
Keyphrases
- training process
- communication overhead
- communication cost
- cooperative
- computer networks
- lightweight
- real world
- multi agent
- computationally demanding
- fully distributed
- spatially distributed
- bit vector
- exchange information
- distributed computation
- online learning
- peer to peer
- distributed environment
- sensor networks
- training data
- neural network
- distributed network
- distributed control