Pretrained Encyclopedia: Weakly Supervised Knowledge-Pretrained Language Model.

Wenhan Xiong Jingfei Du William Yang Wang Veselin Stoyanov

Published in: CoRR (2019)

Keyphrases

language model
weakly supervised
probabilistic model
n gram
information retrieval
knowledge base
object class
topic models
knowledge representation
relation extraction
prior knowledge