Frustratingly Simple Pretraining Alternatives to Masked Language Modeling.

Atsuki Yamaguchi George Chrysostomou Katerina Margatina Nikolaos Aletras

Published in: CoRR (2021)

Keyphrases

language modeling
language model
retrieval model
query expansion
n gram
probabilistic model
information retrieval
cross lingual
bayesian networks
document retrieval
sentence retrieval
machine learning
learning algorithm
test collection
statistical language models