3PC: Three Point Compressors for Communication-Efficient Distributed Training and a Better Theory for Lazy Aggregation.
Peter RichtárikIgor SokolovElnur GasanovIlyas FatkhullinZhize LiEduard GorbunovPublished in: ICML (2022)
Keyphrases
- communication cost
- communication overhead
- computer networks
- cooperative
- reduce communication cost
- distributed control
- training set
- distributed systems
- lightweight
- data compression
- theoretical framework
- open systems
- speech acts
- distributed computation
- communication networks
- fully distributed
- data aggregation
- distributed data
- computing environments
- data sets
- fault tolerant
- information sharing
- training samples
- bayesian networks
- e learning