How much pretraining data do language models need to learn syntax?

Laura Pérez-Mayos Miguel Ballesteros Leo Wanner

Published in: EMNLP (1) (2021)

Keyphrases

language model
training data
machine learning
information retrieval
probabilistic model
n gram
xml documents
document retrieval
document clustering
text retrieval
context sensitive
language modeling