Collaborative Multi-Teacher Knowledge Distillation for Learning Low Bit-width Deep Neural Networks.
Cuong PhamTuan HoangThanh-Toan DoPublished in: CoRR (2022)
Keyphrases
- neural network
- knowledge acquisition
- learning process
- learning systems
- prior knowledge
- learning tasks
- learning algorithm
- learning mechanism
- domain knowledge
- knowledge sharing
- learned knowledge
- subject matter
- knowledge transfer
- neural nets
- mobile learning
- background knowledge
- expert systems
- back propagation
- online learning
- organizational learning
- artificial neural networks
- teacher education
- knowledge creation
- knowledge base
- learner model
- teaching learning
- educational process
- connectionist systems