On the Transferability of Pre-trained Language Models: A Study from Artificial Datasets.

David Cheng-Han Chiang Hung-Yi Lee

Published in: AAAI (2022)

Keyphrases

language model
language modeling
n gram
pre trained
data sets
test collection
neural network
information retrieval
probabilistic model
speech recognition
document retrieval
language modelling
feature extraction
semi supervised
supervised learning
retrieval model