Contextual Knowledge Selection and Embedding towards Enhanced Pre-Trained Language Models.
YuSheng SuXu HanZhengyan ZhangPeng LiZhiyuan LiuYankai LinJie ZhouMaosong SunPublished in: CoRR (2020)
Keyphrases
- language model
- contextual knowledge
- pre trained
- language modeling
- contextual information
- n gram
- probabilistic model
- speech recognition
- document retrieval
- query expansion
- information retrieval
- test collection
- training data
- retrieval model
- smoothing methods
- training examples
- case based reasoning
- relevance model
- vector space
- query terms
- control signals
- data sets
- expert systems
- generative model
- prior knowledge
- neural network