Why Skip If You Can Combine: A Simple Knowledge Distillation Technique for Intermediate Layers.
Yimeng WuPeyman PassbanMehdi RezagholizadehQun LiuPublished in: EMNLP (1) (2020)
Keyphrases
- knowledge management
- knowledge base
- domain knowledge
- knowledge structures
- raw data
- knowledge acquisition
- information retrieval
- knowledge sharing
- domain experts
- prior knowledge
- knowledge extraction
- database
- background knowledge
- domain specific
- natural language
- database systems
- artificial intelligence
- genetic algorithm
- machine learning
- real time