Understanding Communication Characteristics of Distributed Training.
Wenxue LiXiangzhou LiuYuxuan LiYilun JinHan TianZhizhen ZhongGuyue LiuYing ZhangKai ChenPublished in: APNet (2024)
Keyphrases
- communication overhead
- communication cost
- computer networks
- distributed control
- fully distributed
- distributed systems
- distributed environment
- distributed network
- open systems
- training set
- spatially distributed
- test set
- mobile agents
- information dissemination
- multi party
- cooperative
- distributed computation
- single point of failure
- training process
- communication networks
- communication systems
- communication protocol
- fault tolerant
- group communication
- interprocess communication
- training algorithm
- information sharing
- network nodes
- lightweight
- online learning
- peer to peer
- mobile devices
- data sets
- hearing impaired