Knowledge Distillation Performs Partial Variance Reduction.

Mher Safaryan Alexandra Peste Dan Alistarh

Published in: NeurIPS (2023)

Keyphrases

variance reduction
knowledge discovery
gradient estimation
sample size
reinforcement learning
prior knowledge
markov random field
quasi monte carlo