3PC: Three Point Compressors for Communication-Efficient Distributed Training and a Better Theory for Lazy Aggregation.
Peter RichtárikIgor SokolovIlyas FatkhullinElnur GasanovZhize LiEduard A. GorbunovPublished in: CoRR (2022)
Keyphrases
- communication cost
- reduce communication cost
- communication overhead
- fully distributed
- distributed environment
- computer networks
- neural network
- distributed control
- online learning
- lightweight
- information dissemination
- information sharing
- multi agent
- interprocess communication
- global knowledge
- network nodes
- open systems
- communication networks
- data aggregation
- training process
- personal computer
- theoretical framework
- test set
- distributed systems
- query processing
- training set
- bayesian networks