LM: Probabilistically Permuted Prophet Language Modeling for Generative Pre-Training.
Junwei BaoYifan WangJiangyong YingYeyun GongJing ZhaoYouzheng WuXiaodong HePublished in: CoRR (2022)
Keyphrases
- language modeling
- language model
- information retrieval
- retrieval model
- query expansion
- cross lingual
- n gram
- discriminative models
- probabilistic model
- language modeling framework
- generative model
- text classification
- document retrieval
- training set
- unsupervised learning
- neural network
- relevance model
- sentence retrieval
- statistical language models
- improvements in retrieval effectiveness
- text categorization
- feature extraction
- statistical language modeling