Learning to Retain while Acquiring: Combating Distribution-Shift in Adversarial Data-Free Knowledge Distillation.
Gaurav PatelKonda Reddy MopuriQiang QiuPublished in: CoRR (2023)
Keyphrases
- prior knowledge
- raw data
- data sets
- background knowledge
- learning systems
- data mining techniques
- learning process
- synthetic data
- knowledge acquisition
- training data
- data structure
- data distribution
- uniformly distributed
- learning algorithm
- data collection
- data processing
- knowledge transfer
- previously learned
- knowledge discovery
- expert systems
- data analysis
- search engine
- neural network
- image data
- knowledge representation
- data sources
- domain knowledge
- missing data
- domain experts
- human experts
- metadata
- data quality
- expert knowledge
- knowledge base