Is Network the Bottleneck of Distributed Training?
Zhen ZhangChaokun ChangHaibin LinYida WangRaman AroraXin JinPublished in: CoRR (2020)
Keyphrases
- peer to peer
- computer networks
- distributed network
- communication overhead
- single point of failure
- network model
- communication cost
- data transfer
- network nodes
- recurrent networks
- distributed systems
- online learning
- complex networks
- network traffic
- communication networks
- load balance
- heterogeneous networks
- mobile sensor
- neural network
- multi agent
- network structure
- active learning
- computing environments
- mobile agents
- data sets
- neural network structure
- central server
- multi agent systems
- lightweight
- camera network
- load balancing
- network management
- training phase
- data flow
- distributed computing
- distributed environment