Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learning.

Zeyuan Allen-Zhu Yuanzhi Li

Published in: ICLR (2023)

Keyphrases

deep learning
unsupervised feature learning
knowledge discovery
machine learning
learning algorithm
pattern recognition
text mining
feature selection
natural language
restricted boltzmann machine