On the Inductive Bias of Masked Language Modeling: From Statistical to Syntactic Dependencies.
Tianyi ZhangTatsunori HashimotoPublished in: CoRR (2021)
Keyphrases
- language modeling
- language model
- inductive bias
- retrieval model
- information retrieval
- syntactic dependencies
- query expansion
- cross lingual
- n gram
- probabilistic model
- text classification
- semantic role labeling
- machine learning
- document retrieval
- prior knowledge
- dependency parsing
- domain knowledge
- knowledge discovery
- information retrieval systems
- feature extraction