Expediting Distributed DNN Training With Device Topology-Aware Graph Deployment.
Shiwei ZhangXiaodong YiLansong DiaoChuan WuSiyu WangWei LinPublished in: IEEE Trans. Parallel Distributed Syst. (2023)
Keyphrases
- training process
- graph representation
- graph structure
- directed graph
- peer to peer
- distributed systems
- training set
- small world
- graph model
- graph mining
- computer networks
- graph matching
- distributed sensor networks
- neural network
- topological information
- training algorithm
- remote server
- test set
- cooperative
- multi agent
- training data
- communication cost
- graph theory
- directed acyclic graph
- bipartite graph
- distributed environment
- distributed data
- lightweight
- fully connected
- data sets