Layerwise Bregman Representation Learning of Neural Networks with Applications to Knowledge Distillation.
Ehsan AmidRohan AnilChristopher FiftyManfred K. WarmuthPublished in: Trans. Mach. Learn. Res. (2023)
Keyphrases
- neural network
- learning systems
- knowledge acquisition
- prior knowledge
- domain knowledge
- learning algorithm
- multiple representations
- supervised learning
- solving problems
- incremental learning
- procedural knowledge
- knowledge based systems
- knowledge discovery
- knowledge representation
- learned knowledge
- complex domains
- knowledge level
- organizational learning
- connectionist systems
- domain experts
- learning rules
- concept maps
- maximum entropy
- learning tasks
- background knowledge
- unsupervised learning
- knowledge management
- knowledge base
- genetic algorithm