Inplace knowledge distillation with teacher assistant for improved training of flexible deep neural networks.
Alexey OzerovNgoc Q. K. DuongPublished in: EUSIPCO (2021)
Keyphrases
- neural network
- training process
- training algorithm
- feedforward neural networks
- genetic algorithm
- feed forward neural networks
- knowledge base
- knowledge representation
- expert systems
- domain knowledge
- knowledge discovery
- recurrent neural networks
- neural network training
- professional development
- knowledge sharing
- test set
- knowledge management
- artificial neural networks
- domain experts
- learning experience
- knowledge based systems
- supervised learning
- semi supervised
- fuzzy logic
- prior knowledge