Self-training Improves Pre-training for Natural Language Understanding.
Jingfei DuEdouard GraveBeliz GunelVishrav ChaudharyOnur CelebiMichael AuliVes StoyanovAlexis ConneauPublished in: CoRR (2020)
Keyphrases
- natural language understanding
- training set
- text understanding
- semantic analysis
- language understanding
- knowledge representation
- semantic representations
- natural language processing
- natural language
- spoken dialog systems
- joint inference
- dialogue system
- training examples
- database
- semi supervised
- expert systems
- abductive reasoning
- domain specific
- co training
- intelligent systems
- supervised learning
- low level
- domain knowledge
- active learning
- web pages