Rethinking Knowledge Distillation via Cross-Entropy.

Zhendong Yang Zhe Li Yuan Gong Tianke Zhang Shanshan Lao Chun Yuan Yu Li

Published in: CoRR (2022)

Keyphrases

cross entropy
evaluation metrics
language modeling
minimum cross entropy
bayesian networks
information extraction
maximum likelihood