Knowledge Distillation in Vision Transformers: A Critical Review.
Gousia HabibTausifa Jan SaleemBrejesh LallPublished in: CoRR (2023)
Keyphrases
- domain knowledge
- knowledge based systems
- knowledge management
- knowledge base
- knowledge acquisition
- knowledge extraction
- real time
- knowledge discovery
- prior knowledge
- expert systems
- computer vision
- knowledge representation
- decision making
- knowledge sources
- knowledge sharing
- knowledge transfer
- case based reasoning
- background knowledge
- semantic information
- learning systems
- design process
- vision system
- case study
- machine learning
- neural network