RA-KD: Random Attention Map Projection for Knowledge Distillation.
Linna ZhangYuehui ChenYi CaoYaou ZhaoPublished in: ICIC (4) (2023)
Keyphrases
- expert systems
- domain knowledge
- knowledge acquisition
- knowledge extraction
- knowledge base
- prior knowledge
- real world
- maximum a posteriori
- background knowledge
- knowledge management
- machine learning
- data mining techniques
- knowledge representation
- higher level
- multi agent
- knowledge sources
- neural network
- uniformly distributed
- cognitive map