bbTopk: Bandwidth-Aware Sparse Allreduce with Blocked Sparsification for Efficient Distributed Training.

Chang Chen Min Li Chao Yang

Published in: ICDCS (2023)

Keyphrases

distributed systems
lightweight
high dimensional
least squares
supervised learning
computationally expensive
data sets
multi agent
cooperative
training samples
image reconstruction
fault tolerant