Teach Harder, Learn Poorer: Rethinking Hard Sample Distillation for GNN-to-MLP Knowledge Distillation.
Lirong WuYunfan LiuHaitao LinYufei HuangStan Z. LiPublished in: CoRR (2024)
Keyphrases
- domain knowledge
- neural network
- knowledge discovery
- complex domains
- children learn
- acquire knowledge
- knowledge acquisition
- expert systems
- radial basis function
- knowledge based systems
- back propagation
- learning systems
- data mining techniques
- multilayer perceptron
- knowledge extraction
- rbf network
- multi layer perceptron
- knowledge management
- knowledge representation
- prior knowledge