Rethinking embedding coupling in pre-trained language models.
Hyung Won ChungThibault FévryHenry TsaiMelvin JohnsonSebastian RuderPublished in: CoRR (2020)
Keyphrases
- language model
- pre trained
- language modeling
- n gram
- training data
- training examples
- information retrieval
- probabilistic model
- document retrieval
- speech recognition
- retrieval model
- test collection
- statistical language models
- query expansion
- vector space
- control signals
- language modelling
- document ranking
- language models for information retrieval
- smoothing methods
- relevance model
- active learning
- object tracking
- multi modal
- feature extraction
- machine learning