SKDBERT: Compressing BERT via Stochastic Knowledge Distillation.
Zixiang DingGuoqing JiangShuai ZhangLin GuoWei LinPublished in: AAAI (2023)
Keyphrases
- knowledge acquisition
- knowledge representation
- knowledge base
- prior knowledge
- domain knowledge
- databases
- data sets
- domain experts
- learning systems
- knowledge extraction
- domain ontology
- knowledge management
- knowledge discovery
- expert systems
- higher level
- background knowledge
- metadata
- knowledge sharing
- artificial intelligence