Why Do Pretrained Language Models Help in Downstream Tasks? An Analysis of Head and Prompt Tuning.

Colin Wei Sang Michael Xie Tengyu Ma

Published in: CoRR (2021)

Keyphrases

language model
n gram
probabilistic model
language modeling
information retrieval
document retrieval
language modelling
co occurrence