Distilling Knowledge from Pre-trained Language Models via Text Smoothing.
Xing WuYibing LiuXiangyang ZhouDianhai YuPublished in: CoRR (2020)
Keyphrases
- language model
- smoothing methods
- information retrieval
- language modeling
- language models for information retrieval
- pre trained
- probabilistic model
- document retrieval
- retrieval model
- language modelling
- language modeling approaches
- speech recognition
- n gram
- statistical language models
- semantic information
- text retrieval
- document length
- prior knowledge
- query expansion
- information extraction
- machine learning
- data sets
- test collection
- context sensitive
- image classification
- language modeling framework