Distill on the Go: Online knowledge distillation in self-supervised learning.
Prashant BhatElahe AraniBahram ZonoozPublished in: CoRR (2021)
Keyphrases
- online learning
- learning systems
- prior knowledge
- effective learning
- reinforcement learning
- learning algorithm
- learned knowledge
- learning problems
- learning process
- domain knowledge
- supervised learning
- background knowledge
- knowledge acquisition
- learning analytics
- human experts
- knowledge management
- active learning
- case study
- previously learned
- inductive inference
- neural network
- learning scheme
- knowledge transfer
- mobile learning
- knowledge base
- machine learning