DearKD: Data-Efficient Early Knowledge Distillation for Vision Transformers.
Xianing ChenQiong CaoYujie ZhongJing ZhangShenghua GaoDacheng TaoPublished in: CVPR (2022)
Keyphrases
- data collection
- database
- raw data
- data sets
- prior knowledge
- real time
- original data
- data structure
- domain knowledge
- data mining techniques
- knowledge discovery
- input data
- synthetic data
- data processing
- data sources
- data analysis
- high quality
- data points
- knowledge based systems
- data retrieval
- experimental data
- training data
- enormous amounts
- knowledge management
- stored data
- complex data
- information systems
- network structure
- domain experts
- missing data
- knowledge acquisition
- probability distribution