Using Triangle Exchange Mechanism to Accelerate the Pre-training Convergence Speed of BERT.
Jingjing LiaoNanzhi WangGuocai YangPublished in: CSAI (2020)
Keyphrases
- convergence speed
- differential evolution
- convergence rate
- particle swarm optimization algorithm
- particle swarm optimization
- global search
- training speed
- global convergence
- step size
- ant colony optimization algorithm
- learning rate
- population diversity
- pso algorithm
- firefly algorithm
- strong robustness
- steady state error
- faster convergence
- training process
- premature convergence
- multi objective
- training algorithm
- training phase
- neural network
- global optimization
- metaheuristic
- optimization algorithm
- search engine
- genetic algorithm