Data-Free Distillation of Language Model by Text-to-Text Transfer.

Zheyuan Bai Xinduo Liu Hailin Hu Tianyu Guo Qinghua Zhang Yunhe Wang

Published in: CoRR (2023)

Keyphrases

language model
information retrieval
n gram
language modeling
textual data
text retrieval
probabilistic model
query expansion
document retrieval
text categorization
speech recognition
test collection
multiword
textual documents
statistical language models