Retentive or Forgetful? Diving into the Knowledge Memorizing Mechanism of Language Models.
Boxi CaoQiaoyu TangHongyu LinShanshan JiangBin DongXianpei HanJiawei ChenTianshu WangLe SunPublished in: LREC/COLING (2024)
Keyphrases
- language model
- language modeling
- probabilistic model
- document retrieval
- n gram
- speech recognition
- information retrieval
- statistical language models
- relevance model
- retrieval model
- language modelling
- test collection
- knowledge discovery
- translation model
- information retrieval systems
- query expansion
- semantic information
- vector space model
- ad hoc information retrieval
- language models for information retrieval