What Context Features Can Transformer Language Models Use?
Joe O'ConnorJacob AndreasPublished in: CoRR (2021)
Keyphrases
- language model
- language modeling
- context sensitive
- probabilistic model
- n gram
- speech recognition
- document retrieval
- translation model
- retrieval model
- image features
- low level
- classification accuracy
- smoothing methods
- language modelling
- statistical language models
- query expansion
- feature vectors
- information retrieval
- language models for information retrieval
- language model for information retrieval
- term dependencies
- relevance model
- vector space model
- co occurrence
- feature space