Syntactic Inductive Bias in Transformer Language Models: Especially Helpful for Low-Resource Languages?
Luke GesslerNathan SchneiderPublished in: CoRR (2023)
Keyphrases
- language model
- inductive bias
- language modeling
- cross lingual
- document retrieval
- n gram
- probabilistic model
- query expansion
- retrieval model
- machine learning
- information retrieval
- inductive learning
- translation model
- domain knowledge
- context sensitive
- prior knowledge
- language models for information retrieval
- natural language
- relevance model
- training examples
- supervised learning
- pac learning
- smoothing methods
- active learning
- decision trees