Information Theoretic Representation Distillation.
Roy MilesAdrián López RodríguezKrystian MikolajczykPublished in: BMVC (2022)
Keyphrases
- information theoretic
- information theory
- mutual information
- theoretic framework
- information bottleneck
- information theoretic measures
- entropy measure
- log likelihood
- multi modality
- distributional clustering
- minimum description length
- bregman divergences
- relative entropy
- kl divergence
- kullback leibler divergence
- computational learning theory
- data mining
- pattern recognition
- similarity measure