An Information-Theoretic Perspective on Variance-Invariance-Covariance Regularization.
Ravid Shwartz-ZivRandall BalestrieroKenji KawaguchiTim G. J. RudnerYann LeCunPublished in: CoRR (2023)
Keyphrases
- information theoretic
- information theory
- mutual information
- relative entropy
- theoretic framework
- covariance matrix
- bregman divergences
- kl divergence
- information bottleneck
- log likelihood
- information theoretic measures
- jensen shannon divergence
- entropy measure
- multi modality
- discriminative power
- kullback leibler divergence
- computational learning theory
- medical images
- distributional clustering
- machine learning
- selection criterion
- image registration
- image segmentation