RAIL-KD: RAndom Intermediate Layer Mapping for Knowledge Distillation.
Md. Akmal HaidarNithin AnchuriMehdi RezagholizadehAbbas GhaddarPhilippe LanglaisPascal PoupartPublished in: CoRR (2021)
Keyphrases
- domain knowledge
- expert systems
- knowledge base
- knowledge acquisition
- databases
- knowledge based systems
- prior knowledge
- learning systems
- design process
- higher level
- knowledge discovery
- background knowledge
- knowledge sources
- knowledge extraction
- semantic information
- intermediate level
- middle layer
- collaborative learning
- domain experts
- knowledge management
- bayesian networks
- decision making
- information systems
- machine learning
- real world