SAS: Self-Augmentation Strategy for Language Model Pre-training.

Yifei Xu Jingqiao Zhang Ru He Liangzhu Ge Chao Yang Cheng Yang Ying Nian Wu

Published in: AAAI (2022)

Keyphrases

language model
language modeling
n gram
probabilistic model
document retrieval
retrieval model
information retrieval

speech recognition
language modelling
query expansion
context sensitive
test collection
query terms
translation model

training set
ad hoc information retrieval
vector space model
statistical language models
mixture model
language model for information retrieval
pseudo relevance feedback

relevance model
dependency structure
pseudo feedback
document ranking
query specific
statistical language modeling