RW-KD: Sample-wise Loss Terms Re-Weighting for Knowledge Distillation.
Peng LuAbbas GhaddarAhmad RashidMehdi RezagholizadehAli GhodsiPhilippe LanglaisPublished in: EMNLP (Findings) (2021)
Keyphrases
- random walk
- expert systems
- knowledge sharing
- background knowledge
- domain knowledge
- knowledge transfer
- reinforcement learning
- neural network
- related concepts
- knowledge extraction
- knowledge based systems
- prior knowledge
- knowledge base
- data mining techniques
- knowledge management
- similarity measure
- information systems
- databases