Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learning.

Zeyuan Allen-Zhu Yuanzhi Li

Published in: CoRR (2020)

Keyphrases

deep learning
knowledge base
machine learning
bayesian networks
knowledge discovery
data sets
learning algorithm
computer vision
training data
natural language
feature space
pairwise
prior knowledge
unsupervised learning
weakly supervised
unsupervised feature learning