A Systematic Review of Transformer-Based Pre-Trained Language Models through Self-Supervised Learning.

Evans Kotei Ramkumar Thirunavukarasu

Published in: Inf. (2023)

Keyphrases

language model
language modeling
learning algorithm
systematic review
prior knowledge
document retrieval
probabilistic model
unsupervised learning
smoothing methods
language modelling
information retrieval
active learning
multi modal
query expansion