Generalization through Memorization: Nearest Neighbor Language Models.
Urvashi KhandelwalOmer LevyDan JurafskyLuke ZettlemoyerMike LewisPublished in: CoRR (2019)
Keyphrases
- language model
- nearest neighbor
- language modeling
- probabilistic model
- n gram
- document retrieval
- knn
- retrieval model
- k nearest neighbor
- information retrieval
- statistical language models
- high dimensional
- context sensitive
- query expansion
- speech recognition
- test collection
- language modelling
- smoothing methods
- language model for information retrieval
- document ranking
- vector space model
- data points
- retrieval effectiveness
- query terms
- okapi bm
- ad hoc information retrieval
- training set
- co occurrence
- information extraction