AshPipe: Asynchronous Hybrid Pipeline Parallel for DNN Training.
Ryubu HosokiToshio EndoTakahiro HirofuchiTsutomu IkegamiPublished in: HPC Asia (2024)
Keyphrases
- training process
- asynchronous cellular automata
- test set
- training set
- parallel processing
- computer architecture
- object detection
- neural network
- parallel hardware
- parallel architecture
- feedforward neural networks
- shared memory
- parallel computing
- training phase
- massively parallel
- data mining
- training examples
- depth first search
- training samples
- general purpose
- small number