Interpreting Key Mechanisms of Factual Recall in Transformer-Based Language Models.
Ang LvKaiyi ZhangYuhan ChenYulong WangLifeng LiuJi-Rong WenJian XieRui YanPublished in: CoRR (2024)
Keyphrases
- language model
- language modeling
- n gram
- probabilistic model
- document retrieval
- speech recognition
- information retrieval
- query expansion
- language modelling
- retrieval model
- statistical language models
- test collection
- vector space model
- relevance model
- ad hoc information retrieval
- smoothing methods
- text retrieval
- precision and recall
- context sensitive
- pseudo relevance feedback
- document ranking
- language models for information retrieval
- spoken term detection
- word error rate
- information retrieval systems
- information extraction
- query processing