Teacher as a Lenient Expert: Teacher-Agnostic Data-Free Knowledge Distillation.
Hyunjune ShinDong-Wan ChoiPublished in: AAAI (2024)
Keyphrases
- raw data
- domain experts
- data sets
- data collection
- synthetic data
- data sources
- knowledge discovery
- expert knowledge
- original data
- data mining techniques
- database
- prior knowledge
- data analysis
- training data
- hidden knowledge
- human experts
- experimental data
- probability distribution
- professional development
- databases
- feature space
- sensor data
- learning process
- high quality
- image data
- knowledge representation
- high dimensional data
- knowledge base
- knowledge acquisition
- end users
- data structure
- web pages
- data mining
- multiple sources
- stored data
- expert systems