StableKD: Breaking Inter-block Optimization Entanglement for Stable Knowledge Distillation.
Shiu-hong KaoJierun ChenShueng-Han Gary ChanPublished in: CoRR (2023)
Keyphrases
- knowledge base
- expert systems
- knowledge representation
- knowledge acquisition
- background knowledge
- global optimization
- optimization algorithm
- knowledge management
- bayesian networks
- domain experts
- knowledge sharing
- optimization process
- knowledge transfer
- learning systems
- genetic algorithm
- conceptual model
- combinatorial optimization
- decision trees
- knowledge sources
- knowledge extraction
- optimization model
- block size