How Much Do Modifications to Transformer Language Models Affect Their Ability to Learn Linguistic Knowledge?
Simeng SunBrian DillonMohit IyyerPublished in: Insights@ACL (2022)
Keyphrases
- language model
- linguistic knowledge
- language modeling
- natural language
- n gram
- document retrieval
- natural language processing
- retrieval model
- dialogue system
- probabilistic model
- test collection
- query expansion
- information retrieval
- semantic knowledge
- smoothing methods
- translation model
- word sense disambiguation
- vector space model
- relevance model
- language models for information retrieval
- pseudo relevance feedback
- text retrieval
- query terms
- vector space
- feature extraction
- machine learning