Improved knowledge distillation by utilizing backward pass knowledge in neural networks.
Aref JafariMehdi RezagholizadehAli GhodsiPublished in: CoRR (2023)
Keyphrases
- neural network
- domain knowledge
- knowledge acquisition
- knowledge extraction
- artificial neural networks
- genetic algorithm
- higher level
- domain experts
- databases
- metadata
- database systems
- training data
- search algorithm
- knowledge base
- evolutionary algorithm
- computer vision
- learning systems
- conceptual model
- knowledge sources