A Closer Look at Knowledge Distillation with Features, Logits, and Gradients.
Yen-Chang HsuJames SmithYilin ShenZsolt KiraHongxia JinPublished in: CoRR (2022)
Keyphrases
- feature set
- feature extraction
- domain knowledge
- knowledge extraction
- low level
- feature vectors
- prior knowledge
- knowledge acquisition
- knowledge sources
- feature space
- image features
- object detection
- knowledge management
- knowledge base
- false positives
- keypoints
- semantic models
- key features
- neural network
- semantic information
- learning systems
- knowledge representation
- expert systems
- multiscale
- computer vision