Estimating and Maximizing Mutual Information for Knowledge Distillation.
Aman ShrivastavaYanjun QiVicente OrdonezPublished in: CoRR (2021)
Keyphrases
- mutual information
- knowledge base
- similarity measure
- knowledge sources
- knowledge based systems
- knowledge extraction
- expert systems
- domain knowledge
- image registration
- knowledge management
- learning systems
- information theoretic
- knowledge sharing
- mutual information maximization
- neural network
- knowledge transfer
- knowledge acquisition
- prior knowledge
- feature selection
- information systems