Unified Language Model Pre-training for Natural Language Understanding and Generation.
Li DongNan YangWenhui WangFuru WeiXiaodong LiuYu WangJianfeng GaoMing ZhouHsiao-Wuen HonPublished in: CoRR (2019)
Keyphrases
- language model
- natural language understanding
- language modeling
- probabilistic model
- semantic analysis
- n gram
- natural language
- document retrieval
- speech recognition
- knowledge representation
- language understanding
- retrieval model
- test collection
- information retrieval
- query expansion
- mixture model
- natural language processing
- context sensitive
- smoothing methods
- ad hoc information retrieval
- statistical language models
- query terms
- dialogue system
- document length
- language modelling
- language model for information retrieval
- statistical machine translation
- contextual information