Login / Signup
AutoTinyBERT: Automatic Hyper-parameter Optimization for Efficient Pre-trained Language Models.
Yichun Yin
Cheng Chen
Lifeng Shang
Xin Jiang
Xiao Chen
Qun Liu
Published in:
CoRR (2021)
Keyphrases
</>
language model
parameter optimization
language modeling
pre trained
n gram
information retrieval
speech recognition
probabilistic model
smoothing methods
genetic algorithm ga
data sets
feature selection
differential evolution
feature space
parameter settings