Pretraining with Artificial Language: Studying Transferable Knowledge in Language Models.

Ryokan Ri Yoshimasa Tsuruoka

Published in: CoRR (2022)

Keyphrases

language model
language modeling
n gram
speech recognition
query expansion
document retrieval
probabilistic model
test collection
information retrieval
statistical language models
context sensitive
retrieval model
document ranking
query terms
text classification
vector space model
relevance model
natural language