Is Network the Bottleneck of Distributed Training?
Zhen ZhangChaokun ChangHaibin LinYida WangRaman AroraXin JinPublished in: NetAI@SIGCOMM (2020)
Keyphrases
- distributed network
- computer networks
- peer to peer
- communication overhead
- communication cost
- network nodes
- data transfer
- single point of failure
- communication networks
- network structure
- central server
- camera network
- distributed environment
- load balance
- distributed data
- distributed systems
- heterogeneous networks
- social networks
- recurrent networks
- information dissemination
- radial basis function network
- neural network
- network management
- training phase
- computing environments
- peer to peer networks
- network resources
- network topologies
- local area network
- training set
- multi agent
- online learning
- distributed control
- complex networks