Augmenting Knowledge Distillation With Peer-To-Peer Mutual Learning For Model Compression.
Usma NiyazDeepti R. BathulaPublished in: CoRR (2021)
Keyphrases
- learning systems
- prior knowledge
- learning models
- high level
- probabilistic model
- mathematical model
- knowledge acquisition
- learning scheme
- reinforcement learning
- expert knowledge
- knowledge transfer
- formal model
- learner model
- computational model
- peer to peer
- domain knowledge
- learning algorithm
- knowledge management
- supervised learning
- semi supervised
- conceptual model
- compression ratio
- data compression
- expert systems
- bayesian networks
- similarity measure
- learned models
- learned knowledge
- machine learning