PipePar: A Pipelined Hybrid Parallel Approach for Accelerating Distributed DNN Training.
Jiange LiYuchen WangJinghui ZhangJiahui JinFang DongLei QianPublished in: CSCWD (2021)
Keyphrases
- training process
- distributed processing
- master slave
- training set
- distributed systems
- peer to peer
- parallel execution
- training phase
- distributed environment
- lightweight
- parallel implementation
- single processor
- training algorithm
- test set
- parallel genetic algorithm
- cooperative
- parallel query processing
- neural network
- parallel architecture
- distributed memory
- heterogeneous environments
- distributed network
- distributed computing
- supervised learning
- data sets
- multi processor
- commodity hardware
- parallel data mining
- computer architecture
- hybrid learning
- parallel computing
- shared memory
- fault tolerant
- training samples
- decision trees
- learning algorithm
- machine learning