DearKD: Data-Efficient Early Knowledge Distillation for Vision Transformers.
Xianing ChenQiong CaoYujie ZhongJing ZhangShenghua GaoDacheng TaoPublished in: CoRR (2022)
Keyphrases
- data sets
- knowledge discovery
- raw data
- domain experts
- data quality
- synthetic data
- input data
- data structure
- data collection
- data analysis
- data processing
- prior knowledge
- domain knowledge
- data sources
- background knowledge
- high dimensional data
- hidden knowledge
- vision system
- expert systems
- metadata
- high quality
- image processing
- privacy preserving
- information systems
- computer vision
- attribute values
- sensor data
- databases
- real time
- multiple sources
- structured information
- database