Login / Signup
Bridging the Gap between Decision and Logits in Decision-based Knowledge Distillation for Pre-trained Language Models.
Qinhong Zhou
Zonghan Yang
Peng Li
Yang Liu
Published in:
CoRR (2023)
Keyphrases
</>
language model
information retrieval
speech recognition
probabilistic model
n gram
language modeling
pre trained
document retrieval
neural network
prior knowledge
test collection
statistical model
language modelling