Reminding the Incremental Language Model via Data-Free Self-Distillation.

Han Wang Ruiliu Fu Chengzhang Li Xuejun Zhang Jun Zhou Yonghong Yan

Published in: CoRR (2021)

Keyphrases

language model
language modeling
information retrieval
probabilistic model
mixture model
n gram
language modelling