GOAT: Gradient Scheduling with Collaborative In-Network Aggregation for Distributed Training.
Jin FangGongming ZhaoHongli XuZhuolong YuBingchen ShenLiguang XiePublished in: IWQoS (2023)
Keyphrases
- distributed network
- peer to peer
- computer networks
- communication overhead
- message exchange
- communication cost
- distributed systems
- cooperative
- distributed environment
- data transfer
- remote sites
- geographically dispersed
- recurrent networks
- camera network
- training process
- scheduling problem
- computing environments
- meeting scheduling
- multi agent
- peer to peer networks
- communication networks
- training set
- resource utilization
- load balance
- dynamic scheduling
- network nodes
- training data
- distributed learning environments
- wide area network
- collaborative learning
- computational grids
- round robin
- mobile agents
- data aggregation
- neural network
- scheduling algorithm
- network model