Distilling Large Language Models into Tiny and Effective Students using pQRNN.
Prabhu KaliamoorthiAditya SiddhantEdward LiMelvin JohnsonPublished in: CoRR (2021)
Keyphrases
- language model
- language modeling
- query expansion
- document retrieval
- language modelling
- n gram
- speech recognition
- statistical language models
- probabilistic model
- test collection
- retrieval model
- context sensitive
- smoothing methods
- information retrieval
- learning process
- document length
- document ranking
- language modeling framework
- relevance model
- pseudo relevance feedback
- information extraction
- multimedia