A Study of Pre-trained Language Models in Natural Language Processing.

Jiajia Duan Hui Zhao Qian Zhou Meikang Qiu Meiqin Liu

Published in: SmartCloud (2020)

Keyphrases

language model
natural language processing
language modeling
probabilistic model
document retrieval
information retrieval
n gram
machine learning
language modelling
information extraction
pre trained
statistical language models
natural language
hidden markov models
generative model
test collection