Self-training Improves Pre-training for Natural Language Understanding.
Jingfei DuEdouard GraveBeliz GunelVishrav ChaudharyOnur CelebiMichael AuliVeselin StoyanovAlexis ConneauPublished in: NAACL-HLT (2021)
Keyphrases
- natural language understanding
- text understanding
- training set
- natural language
- knowledge representation
- semantic analysis
- natural language processing
- language understanding
- spoken dialog systems
- dialogue system
- training process
- abductive reasoning
- semantic representations
- semi supervised
- semi supervised learning
- joint inference
- training examples
- cost sensitive
- artificial intelligence
- domain independent
- database
- information extraction
- metadata
- machine learning
- data mining