Language Models Implement Simple Word2Vec-style Vector Arithmetic.
Jack MerulloCarsten EickhoffEllie PavlickPublished in: NAACL-HLT (2024)
Keyphrases
- language model
- n gram
- language modeling
- translation model
- speech recognition
- probabilistic model
- test collection
- language modelling
- retrieval model
- query expansion
- statistical language models
- document retrieval
- word clouds
- information retrieval
- word error rate
- vector space
- multiword
- statistical language modeling
- language models for information retrieval
- spoken term detection
- context sensitive
- document ranking
- bag of words
- co occurrence
- natural language
- smoothing methods
- relevance model
- okapi bm
- ad hoc information retrieval
- hidden markov models
- feature vectors