The Effect of Masking Strategies on Knowledge Retention by Language Models.
Jonas WallatTianyi ZhangAvishek AnandPublished in: CoRR (2023)
Keyphrases
- language model
- language modeling
- probabilistic model
- n gram
- document retrieval
- language modelling
- information retrieval
- query expansion
- speech recognition
- retrieval model
- vector space model
- test collection
- language models for information retrieval
- statistical language models
- cross lingual
- context sensitive
- query terms
- term dependencies
- web search
- knowledge discovery
- active learning