Accelerated Large Batch Optimization of BERT Pretraining in 54 minutes.
Shuai ZhengHaibin LinSheng ZhaMu LiPublished in: CoRR (2020)
Keyphrases
- optimization algorithm
- global optimization
- data structure
- evolution strategy
- optimization problems
- databases
- optimization process
- constrained optimization
- optimization method
- online algorithms
- joint optimization
- optimization model
- optimization procedure
- multi objective
- learning environment
- artificial intelligence
- information retrieval