The Optimization of Model Parallelization Strategies for Multi-GPU Training.
Zechao ZhangJianfeng ChenBing HuPublished in: GLOBECOM (2021)
Keyphrases
- computational model
- probabilistic model
- global optimization
- training examples
- optimization model
- optimization process
- formal model
- mathematical model
- real time
- objective function
- high level
- probability distribution
- hidden markov models
- optimization method
- genetic algorithm
- prediction model
- neural network
- training algorithm
- data sets