A Primer on Contrastive Pretraining in Language Processing: Methods, Lessons Learned and Perspectives.

Nils Rethmeier Isabelle Augenstein

Published in: CoRR (2021)

Keyphrases

lessons learned
language processing
future directions
natural language
machine learning methods
genetic algorithm
benchmark datasets
significant improvement
natural language processing
machine translation
data sets
artificial intelligence
preprocessing