Communication Optimization for Distributed Training: Architecture, Advances, and Opportunities.
Yunze WeiTianshuo HuCong LiangYong CuiPublished in: CoRR (2024)
Keyphrases
- communication overhead
- fully distributed
- distributed architecture
- communication cost
- hierarchical architecture
- loosely coupled
- computer networks
- distributed processing
- distributed computation
- distributed systems
- optimization algorithm
- agent based architecture
- multi agent architecture
- multimedia communication
- scalable distributed
- master slave
- highly distributed
- management system
- communication protocols
- open systems
- distributed control
- layered architecture
- multi tier
- cyber physical systems
- communication protocol
- spatially distributed
- peer to peer
- training set
- cooperative
- exchange information
- optimization problems
- network architecture
- training process
- recent advances
- distributed network
- artificial intelligence
- multi party
- optimization method
- real time
- heterogeneous systems
- network infrastructure
- heterogeneous environments
- information dissemination
- communication systems
- distributed object
- distributed environment
- training samples
- multi agent
- grid enabled
- hearing impaired