dPRO: A Generic Profiling and Optimization System for Expediting Distributed DNN Training.
Hanpeng HuChenyu JiangYuchen ZhongYanghua PengChuan WuYibo ZhuHaibin LinChuanxiong GuoPublished in: CoRR (2022)
Keyphrases
- training process
- training set
- global optimization
- distributed systems
- discrete optimization
- training algorithm
- domain specific
- optimization method
- optimization algorithm
- data sets
- autonomy oriented computing
- distributed environment
- peer to peer
- training data
- real time
- online learning
- lightweight
- mobile agents
- optimization problems
- supervised learning
- wireless sensor networks
- fault tolerant
- learning process
- loosely coupled
- genetic algorithm