Momentum Adversarial Distillation: Handling Large Distribution Shifts in Data-Free Knowledge Distillation.
Kien DoHung LeDung NguyenDang NguyenHaripriya HarikumarTruyen TranSantu RanaSvetha VenkateshPublished in: CoRR (2022)
Keyphrases
- data sets
- raw data
- data mining techniques
- knowledge discovery
- human experts
- data distribution
- synthetic data
- data analysis
- data sources
- data processing
- training data
- high quality
- probability distribution
- data points
- knowledge representation
- database
- prior knowledge
- knowledge base
- domain experts
- data quality
- attribute values
- multi agent
- high dimensional data
- computer systems
- image data