On the Transformer Growth for Progressive BERT Training.

Xiaotao Gu Liyuan Liu Hongkun Yu Jing Li Chen Chen Jiawei Han

Published in: NAACL-HLT (2021)

Keyphrases

training process
test set
training set
power system
fuzzy logic
data sets
training phase
hidden markov models
multi class
information retrieval
fault diagnosis
real time
mobile robot
support vector machine
web services
supervised learning
computational intelligence
real world
databases
training algorithm