RAIL-KD: RAndom Intermediate Layer Mapping for Knowledge Distillation.
Md. Akmal HaidarNithin AnchuriMehdi RezagholizadehAbbas GhaddarPhilippe LanglaisPascal PoupartPublished in: NAACL-HLT (Findings) (2022)
Keyphrases
- knowledge extraction
- knowledge base
- expert systems
- domain knowledge
- knowledge discovery
- knowledge representation
- knowledge acquisition
- database
- website
- intermediate level
- multi layer
- expert knowledge
- background knowledge
- higher level
- data model
- prior knowledge
- recommender systems
- artificial intelligence
- neural network