Addressing Network Bottlenecks with Divide-and-Shuffle Synchronization for Distributed DNN Training.
Weiyan WangCengguang ZhangLiu YangKai ChenKun TanPublished in: INFOCOM (2022)
Keyphrases
- distributed network
- peer to peer
- training process
- computer networks
- communication overhead
- communication cost
- radial basis function network
- communication networks
- complex networks
- distributed environment
- concurrent processes
- cooperative
- distributed systems
- peer to peer networks
- camera network
- wireless sensor networks
- network model
- recurrent networks
- data sets
- data transfer
- supervised learning
- multi agent
- database systems
- neural network structure
- mobile sensor
- multilayer neural network
- network nodes
- load balance
- information dissemination
- heterogeneous networks
- network management
- computing environments
- fault tolerant
- neural network