On the Transformer Growth for Progressive BERT Training.

Xiaotao Gu Liyuan Liu Hongkun Yu Jing Li Chen Chen Jiawei Han

Published in: CoRR (2020)

Keyphrases

fuzzy logic
training algorithm
training samples
real time
training process
similarity measure
power system
test set
growth model
growth rate
training phase
supervised learning
support vector machine
artificial neural networks
training set
case study
knowledge base
decision making
machine learning
databases