Why Skip If You Can Combine: A Simple Knowledge Distillation Technique for Intermediate Layers.
Yimeng WuPeyman PassbanMehdi RezagholizadehQun LiuPublished in: CoRR (2020)
Keyphrases
- knowledge management
- knowledge base
- data sets
- expert knowledge
- knowledge based systems
- prior knowledge
- databases
- knowledge transfer
- knowledge acquisition
- information systems
- artificial intelligence
- information retrieval
- neural network
- expert systems
- e learning
- knowledge representation
- decision making
- data mining techniques
- knowledge sharing
- knowledge structures