On the Inductive Bias of Masked Language Modeling: From Statistical to Syntactic Dependencies.
Tianyi ZhangTatsunori HashimotoPublished in: NAACL-HLT (2021)
Keyphrases
- language modeling
- language model
- inductive bias
- retrieval model
- information retrieval
- syntactic dependencies
- query expansion
- probabilistic model
- cross lingual
- dependency parsing
- relevance model
- prior knowledge
- n gram
- machine learning
- supervised learning
- semantic role labeling
- text classification
- feature vectors
- test collection
- bayesian networks
- decision trees