Memory-Efficient Pipeline-Parallel DNN Training.
Deepak NarayananAmar PhanishayeeKaiyu ShiXie ChenMatei ZahariaPublished in: ICML (2021)
Keyphrases
- memory efficient
- training process
- iterative deepening
- external memory
- training set
- multiple sequence alignment
- training phase
- shared memory
- multithreading
- genetic algorithm
- integral image
- training algorithm
- parallel processing
- online learning
- supervised learning
- parallel implementation
- parallel computation
- orders of magnitude
- parallel programming
- training examples
- parallel architecture
- support vector
- data structure