LOSP: Overlap Synchronization Parallel With Local Compensation for Fast Distributed Training.
Haozhao WangZhihao QuSong GuoNingqi WangRuixuan LiWeihua ZhuangPublished in: IEEE J. Sel. Areas Commun. (2021)
Keyphrases
- distributed processing
- distributed systems
- distributed environment
- multi agent
- test set
- parallel execution
- interprocess communication
- parallel query processing
- shared memory
- training process
- load balance
- master slave
- map reduce
- parallel implementation
- parallel processing
- parallel data mining
- cooperative
- training examples
- training samples
- peer to peer
- mobile agents
- online learning
- communication overhead
- query processing
- multiple independent
- scheduling problem
- supervised learning
- lightweight
- parallel programming
- computer architecture
- massively parallel
- training phase
- training algorithm
- web services
- communication cost
- computing environments