Information Theoretic Representation Distillation.
Roy MilesAdrián López RodríguezKrystian MikolajczykPublished in: CoRR (2021)
Keyphrases
- information theoretic
- mutual information
- information theory
- theoretic framework
- jensen shannon divergence
- information bottleneck
- entropy measure
- information theoretic measures
- kullback leibler divergence
- log likelihood
- relative entropy
- distributional clustering
- computational learning theory
- multi modality
- multi modal
- learning theory
- image processing