Pea-KD: Parameter-efficient and Accurate Knowledge Distillation.
Ikhyun ChoU KangPublished in: CoRR (2020)
Keyphrases
- computationally efficient
- domain knowledge
- knowledge extraction
- knowledge discovery
- cost effective
- artificial intelligence
- prior knowledge
- artificial neural networks
- knowledge representation
- data sets
- knowledge management
- digital libraries
- learning systems
- domain experts
- knowledge base
- expert knowledge
- highly accurate