Improving Knowledge Distillation via Regularizing Feature Norm and Direction.
Yuzhu WangLechao ChengManni DuanYongheng WangZunlei FengShu KongPublished in: CoRR (2023)
Keyphrases
- domain knowledge
- learning systems
- similarity measure
- expert systems
- feature vectors
- knowledge acquisition
- databases
- expert knowledge
- multiscale
- knowledge representation
- knowledge discovery
- knowledge sharing
- knowledge structures
- knowledge transfer
- raw data
- higher level
- feature set
- case study
- website
- knowledge base
- computer vision