Small Scale Data-Free Knowledge Distillation.
He LiuYikai WangHuaping LiuFuchun SunAnbang YaoPublished in: CoRR (2024)
Keyphrases
- small scale
- raw data
- data sets
- synthetic data
- background knowledge
- data collection
- data distribution
- domain experts
- image data
- knowledge discovery
- expert systems
- data sources
- complex data
- high quality
- data structure
- data analysis
- data mining techniques
- database
- knowledge based systems
- knowledge acquisition
- training data
- original data
- expert knowledge
- domain knowledge
- statistical analysis
- prior knowledge
- sensor data
- human experts
- search engine
- neural network
- data mining tools
- acquisition process