Learning to Augment for Data-scarce Domain BERT Knowledge Distillation.
Lingyun FengMinghui QiuYaliang LiHai-Tao ZhengYing ShenPublished in: AAAI (2021)
Keyphrases
- prior knowledge
- domain experts
- data sets
- raw data
- data mining techniques
- human experts
- data collection
- database
- previously learned
- background knowledge
- data analysis
- data processing
- learning systems
- high dimensional data
- image data
- knowledge discovery
- data sources
- domain knowledge
- neural network
- data structure
- learning algorithm
- meta knowledge
- end users
- learned knowledge
- organizational learning
- learning models
- machine learning
- knowledge base
- decision trees
- synthetic data
- knowledge based systems
- knowledge acquisition
- training data
- data quality
- expert knowledge
- multiple sources
- xml documents
- general knowledge
- active learning
- domain specific