Large Language Models Struggle to Learn Long-Tail Knowledge.
Nikhil KandpalHaikang DengAdam RobertsEric WallaceColin RaffelPublished in: CoRR (2022)
Keyphrases
- language model
- long tail
- language modeling
- document retrieval
- n gram
- language modelling
- probabilistic model
- speech recognition
- statistical language models
- information retrieval
- context sensitive
- retrieval model
- language models for information retrieval
- query expansion
- data mining techniques
- relevance model
- document ranking
- knowledge discovery
- recommendation systems
- translation model
- social media
- active learning
- association rules