Distill on the Go: Online Knowledge Distillation in Self-Supervised Learning.
Prashant BhatElahe AraniBahram ZonoozPublished in: CVPR Workshops (2021)
Keyphrases
- online learning
- learning systems
- knowledge acquisition
- prior knowledge
- effective learning
- domain knowledge
- learned knowledge
- organizational learning
- supervised learning
- learning process
- learning algorithm
- knowledge transfer
- real time
- procedural knowledge
- subject matter
- learning scheme
- expert systems
- reinforcement learning
- data mining
- active learning
- conceptual understanding
- neural network
- complex domains
- learning mechanism
- knowledge level
- knowledge base
- solving problems
- knowledge representation
- case based reasoning
- learning tasks
- background knowledge
- machine learning
- decision trees