ERNIE-Gram: Pre-Training with Explicitly N-Gram Masked Language Modeling for Natural Language Understanding.
Dongling XiaoYu-Kun LiHan ZhangYu SunHao TianHua WuHaifeng WangPublished in: CoRR (2020)
Keyphrases
- language modeling
- n gram
- natural language understanding
- language model
- natural language
- knowledge representation
- semantic analysis
- cross lingual
- natural language processing
- statistical language modeling
- language independent
- text classification
- word segmentation
- language modelling
- retrieval model
- part of speech
- information retrieval
- expert finding
- dialogue system
- training set
- probabilistic model
- query expansion
- document retrieval
- finite state transducers
- test collection
- text mining
- expert systems
- retrieval effectiveness
- translation model