Improving Pre-trained Language Models with Syntactic Dependency Prediction Task for Chinese Semantic Error Recognition.
Bo SunBaoxin WangWanxiang CheDayong WuZhigang ChenTing LiuPublished in: CoRR (2022)
Keyphrases
- language model
- pre trained
- syntactic dependencies
- language modeling
- n gram
- dependency parser
- document retrieval
- speech recognition
- probabilistic model
- query expansion
- information retrieval
- error rate
- retrieval model
- feature extraction
- semantic role labeling
- word segmentation
- training data
- query terms
- natural language
- semantic information
- training examples
- pseudo relevance feedback
- translation model
- bayesian networks
- semantic similarity
- unsupervised learning