HPopt: A Hybrid Parallel Optimization Scheduling Approach for Distributed DNN Training.
Caishan WengXinyang LiJinghui ZhangHang YuPublished in: CBD (2023)
Keyphrases
- training process
- meeting scheduling
- dynamic scheduling
- load balance
- master slave
- global optimization
- parallel machines
- optimization problems
- distributed processing
- distributed systems
- optimization algorithm
- parallel implementation
- scheduling algorithm
- distributed environment
- scheduling problem
- multi agent
- round robin
- batch processing machines
- multiple objectives
- training algorithm
- cooperative
- multiprocessor systems
- multiple independent
- computational grids
- training set
- neural network
- genetic algorithm
- parallel database systems
- parallel genetic algorithm
- training samples
- real time database systems
- mobile agents
- training phase
- online learning
- parallel execution
- interconnection networks
- identical machines
- vehicle routing
- computer networks
- optimization process
- distributed computing