Generalized Knowledge Distillation from an Ensemble of Specialized Teachers Leveraging Unsupervised Neural Clustering.
Takashi FukudaGakuto KurataPublished in: ICASSP (2021)
Keyphrases
- unsupervised learning
- neural network
- learning environment
- knowledge base
- information bottleneck
- clustering method
- general purpose
- knowledge representation
- supervised classification
- information theoretic
- knowledge discovery
- effective learning
- knowledge acquisition
- network architecture
- unsupervised manner
- domain knowledge
- unsupervised feature selection
- knowledge management
- data mining techniques
- training set
- expert systems
- learning systems
- design rationale
- unsupervised clustering
- educational content
- subject matter
- life long
- high school
- data clustering
- online learning
- data points
- k means
- learning process
- clustering algorithm
- feature selection
- learning algorithm