Marginal Utility Diminishes: Exploring the Minimum Knowledge for BERT Knowledge Distillation.
Yuanxin LiuFandong MengZheng LinWeiping WangJie ZhouPublished in: ACL/IJCNLP (1) (2021)
Keyphrases
- knowledge base
- domain knowledge
- expert systems
- knowledge extraction
- prior knowledge
- knowledge discovery
- knowledge representation
- conceptual framework
- knowledge sharing
- learning systems
- databases
- knowledge management
- knowledge based systems
- hidden markov models
- domain ontology
- case study
- information systems
- neural network