Momentum Adversarial Distillation: Handling Large Distribution Shifts in Data-Free Knowledge Distillation.
Kien DoHung LeDung NguyenDang NguyenHaripriya HarikumarTruyen TranSantu RanaSvetha VenkateshPublished in: NeurIPS (2022)
Keyphrases
- prior knowledge
- raw data
- data sets
- data distribution
- data structure
- database
- training data
- synthetic data
- statistical analysis
- data processing
- high quality
- data analysis
- high dimensional data
- uniformly distributed
- knowledge discovery
- data mining techniques
- knowledge base
- computer systems
- data collection
- knowledge acquisition
- data sources
- machine learning
- expert systems
- expert knowledge
- data quality
- stored data
- enormous amounts
- random variables
- input data
- data points
- multi agent
- information systems