Sign in
AutoTinyBERT: Automatic Hyper-parameter Optimization for Efficient Pre-trained Language Models.
Yichun Yin
Cheng Chen
Lifeng Shang
Xin Jiang
Xiao Chen
Qun Liu
Published in:
ACL/IJCNLP (1) (2021)
Keyphrases
</>
language model
parameter optimization
language modeling
pre trained
information retrieval
speech recognition
probabilistic model
n gram
differential evolution
genetic algorithm
feature selection
evolutionary algorithm
small number