Hard Gate Knowledge Distillation - Leverage Calibration for Robust and Reliable Language Model.
Dongkyu LeeZhiliang TianYingxiu ZhaoKa Chun CheungNevin L. ZhangPublished in: CoRR (2022)
Keyphrases
- language model
- language modeling
- n gram
- probabilistic model
- document retrieval
- speech recognition
- retrieval model
- statistical language models
- language modelling
- information retrieval
- test collection
- mixture model
- query expansion
- document ranking
- smoothing methods
- context sensitive
- prior knowledge
- retrieval systems
- vector space model
- pseudo relevance feedback