Learning to Retain while Acquiring: Combating Distribution-Shift in Adversarial Data-Free Knowledge Distillation.
Gaurav PatelKonda Reddy MopuriQiang QiuPublished in: CVPR (2023)
Keyphrases
- prior knowledge
- data sets
- background knowledge
- learning systems
- raw data
- data analysis
- data processing
- knowledge acquisition
- probability distribution
- knowledge discovery
- learning algorithm
- image data
- prior domain knowledge
- domain experts
- data sources
- database
- data points
- uniformly distributed
- data quality
- knowledge base
- data structure
- synthetic data
- data collection
- domain knowledge
- online learning
- input data
- data mining techniques
- xml documents
- learning process
- training data
- human experts
- expert knowledge
- data mining tools
- learned models
- procedural knowledge
- acquire knowledge
- supervised learning