Knowledge Enhanced Pretrained Language Models: A Compreshensive Survey.

Xiaokai Wei Shen Wang Dejiao Zhang Parminder Bhatia Andrew O. Arnold

Published in: CoRR (2021)

Keyphrases

language model
language modeling
document retrieval
n gram
probabilistic model
language modelling
retrieval model

smoothing methods
speech recognition
query expansion
translation model
vector space model
document ranking
query terms

text classification
statistical language models
information retrieval
language model for information retrieval
query specific
word error rate
context sensitive

information retrieval systems
knowledge discovery
hidden markov models
decision trees
clustering algorithm
search engine