ALP-KD: Attention-Based Layer Projection for Knowledge Distillation.

Peyman Passban Yimeng Wu Mehdi Rezagholizadeh Qun Liu

Published in: AAAI (2021)

Keyphrases

expert systems
knowledge base
domain knowledge
neural network
knowledge management
real world
learning systems
knowledge extraction
databases
evolutionary algorithm
prior knowledge
domain experts
background knowledge
conceptual model
expert knowledge
multi layer