Up to 100x Faster Data-free Knowledge Distillation.
Gongfan FangKanya MoXinchao WangJie SongShitao BeiHaofei ZhangMingli SongPublished in: CoRR (2021)
Keyphrases
- data sets
- raw data
- data collection
- image data
- data processing
- data sources
- data analysis
- data structure
- domain knowledge
- knowledge discovery
- domain experts
- expert knowledge
- prior knowledge
- data points
- database
- data mining techniques
- machine learning
- input data
- databases
- sensor data
- background knowledge
- neural network
- knowledge acquisition
- training data
- knowledge representation
- expert systems
- knowledge management
- small number
- knowledge base
- data acquisition
- network structure
- website
- data repositories
- stored data
- valuable knowledge