Knowledge Base Grounded Pre-trained Language Models via Distillation.
Raphaël SourtyJosé G. MorenoFrançois-Paul ServantLynda TaminePublished in: SAC (2024)
Keyphrases
- language model
- pre trained
- knowledge base
- language modeling
- probabilistic model
- n gram
- speech recognition
- document retrieval
- training data
- training examples
- language modelling
- query expansion
- information retrieval
- control signals
- test collection
- retrieval model
- statistical language models
- smoothing methods
- pseudo relevance feedback
- language models for information retrieval
- wordnet
- document ranking
- feature extraction
- neural network
- supervised learning
- active learning
- learning process
- data sets