EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets.

Xiaohan Chen Yu Cheng Shuohang Wang Zhe Gan Zhangyang Wang Jingjing Liu

Published in: CoRR (2021)

Keyphrases

computationally expensive
neural network
training examples
website
test set
training process
training phase
database
genetic algorithm
evolutionary algorithm
online learning
lightweight
computationally efficient
cost effective