PANGUBOT: Efficient Generative Dialogue Pre-training from Pre-trained Language Model.
Fei MiYitong LiYulong ZengJingyan ZhouYasheng WangChuanfei XuLifeng ShangXin JiangShiqi ZhaoQun LiuPublished in: CoRR (2022)
Keyphrases
- language model
- pre trained
- language modeling
- n gram
- probabilistic model
- speech recognition
- document retrieval
- information retrieval
- context sensitive
- mixture model
- generative model
- query expansion
- training data
- training examples
- supervised learning
- retrieval model
- ad hoc information retrieval
- prior knowledge
- training set
- data sets