From Cloze to Comprehension: Retrofitting Pre-trained Masked Language Models to Pre-trained Machine Reader.
Weiwen XuXin LiWenxuan ZhangMeng ZhouWai LamLuo SiLidong BingPublished in: NeurIPS (2023)
Keyphrases
- pre trained
- language model
- language modeling
- training data
- n gram
- training examples
- document retrieval
- speech recognition
- information retrieval
- probabilistic model
- query expansion
- retrieval model
- test collection
- statistical language models
- language modelling
- smoothing methods
- neural network
- document ranking
- control signals
- multi modal
- relevance model
- appearance variations
- supervised learning
- active learning
- training set
- spoken term detection