Knowledge distillation via softmax regression representation learning.
Jing YangBrais MartínezAdrian BulatGeorgios TzimiropoulosPublished in: ICLR (2021)
Keyphrases
- prior knowledge
- learning systems
- knowledge acquisition
- expert systems
- learning process
- background knowledge
- online learning
- learned knowledge
- regression model
- knowledge transfer
- inductive inference
- locally weighted
- multiple representations
- procedural knowledge
- effective learning
- solving problems
- knowledge representation
- linear regression
- knowledge level
- representation language
- learning problems
- domain experts
- unsupervised learning
- temporal difference learning
- learning algorithm