LERT: A Linguistically-motivated Pre-trained Language Model.
Yiming CuiWanxiang CheShijin WangTing LiuPublished in: CoRR (2022)
Keyphrases
- language model
- pre trained
- linguistically motivated
- co occurrence
- language modeling
- noun phrases
- linguistic knowledge
- training data
- speech recognition
- natural language
- query expansion
- probabilistic model
- query terms
- training examples
- information retrieval
- n gram
- document retrieval
- retrieval model
- pseudo relevance feedback
- test collection
- statistical model
- vector space model
- semantic features
- user queries
- training set