An efficient bandwidth-adaptive gradient compression algorithm for distributed training of deep neural networks.
Zeqin WangQingyang DuanYuedong XuLiang ZhangPublished in: J. Syst. Archit. (2024)
Keyphrases
- compression algorithm
- neural network
- compression ratio
- image compression
- training process
- data compression
- training algorithm
- bitstream
- compression scheme
- quadtree decomposition
- wavelet based image
- multi layer perceptron
- arithmetic coding
- higher compression ratio
- lossless data compression
- back propagation
- image processing
- computer vision
- low complexity
- image reconstruction
- binary images
- vector quantization
- pattern matching algorithm
- peer to peer
- feature selection