Communication Efficient Distributed Training with Distributed Lion.
Bo LiuLemeng WuLizhang ChenKaizhao LiangJiaxu ZhuChen LiangRaghuraman KrishnamoorthiQiang LiuPublished in: CoRR (2024)
Keyphrases
- distributed systems
- communication overhead
- peer to peer
- communication cost
- distributed environment
- lightweight
- fully distributed
- cooperative
- training set
- multi agent
- online learning
- distributed computation
- mobile agents
- social networks
- computer networks
- distributed architecture
- database
- spatially distributed
- distributed control
- parallel execution
- global knowledge
- distributed computing
- fault tolerant
- training examples
- artificial neural networks
- information systems
- genetic algorithm
- real time