Login / Signup
Bridging the Gap between Decision and Logits in Decision-based Knowledge Distillation for Pre-trained Language Models.
Qinhong Zhou
Zonghan Yang
Peng Li
Yang Liu
Published in:
ACL (1) (2023)
Keyphrases
</>
language model
language modeling
pre trained
probabilistic model
n gram
retrieval model
language modelling
prior knowledge
document retrieval
statistical language models
query expansion
small number
multi modal
training examples
speech recognition