FreezePipe: An Efficient Dynamic Pipeline Parallel Approach Based on Freezing Mechanism for Distributed DNN Training.
Caishan WengZhiyang ShuZhengjia XuJinghui ZhangJunzhou LuoFang DongPeng WangZhengang WangPublished in: CSCWD (2023)
Keyphrases
- training process
- master slave
- multi agent
- cooperative
- peer to peer
- supervised learning
- distributed systems
- selection mechanism
- training phase
- distributed environment
- fault tolerant
- parallel database systems
- single processor
- parallel data mining
- distributed processing
- parallel implementation
- training algorithm
- real time
- parallel processing
- lightweight
- dynamic environments
- active learning
- training data
- computationally efficient
- online learning
- parallel execution
- wireless sensor networks
- multiple independent
- learning algorithm