NUQSGD: Provably Communication-efficient Data-parallel SGD via Nonuniform Quantization.
Ali Ramezani-KebryaFartash FaghriIlia MarkovVitaly AksenovDan AlistarhDaniel M. RoyPublished in: CoRR (2021)
Keyphrases
- data sets
- data processing
- high quality
- database
- data analysis
- statistical analysis
- data distribution
- image data
- data collection
- data structure
- high dimensional data
- synthetic data
- training data
- raw data
- data quality
- data retrieval
- communication channels
- data sources
- feature space
- missing data
- data acquisition
- original data