Accelerating Distributed K-FAC with Smart Parallelism of Computing and Communication Tasks.
Shaohuai ShiLin ZhangBo LiPublished in: CoRR (2021)
Keyphrases
- communication overhead
- communication cost
- computer networks
- distributed systems
- spatially distributed
- distributed control
- distributed computation
- cooperative
- distributed network
- parallel execution
- fully distributed
- computational grids
- interprocess communication
- distributed environment
- information dissemination
- multi party
- computational power
- communication networks
- global knowledge
- loosely coupled
- open systems
- multimedia communication
- distributed data
- group communication
- computing environments
- fault tolerant
- level parallelism
- single point of failure
- mobile agents