Overlapping Communication With Computation in Parameter Server for Scalable DL Training.
Shaoqi WangAidi PiXiaobo ZhouJun WangCheng-Zhong XuPublished in: IEEE Trans. Parallel Distributed Syst. (2021)
Keyphrases
- description logics
- network communication
- training set
- tcp ip
- distributed storage
- control center
- low latency
- training phase
- training process
- database
- communication systems
- hearing impaired
- distributed computation
- client server
- communication cost
- parameter settings
- communication networks
- special case
- network bandwidth
- web server
- test set
- central server
- remote sites
- cloud computing
- training data
- data sets