Information-Theoretic Probing with Minimum Description Length.
Elena VoitaIvan TitovPublished in: CoRR (2020)
Keyphrases
- minimum description length
- information theoretic
- information theory
- mutual information
- theoretic framework
- log likelihood
- information theoretic measures
- information bottleneck
- kullback leibler divergence
- multi modality
- entropy measure
- jensen shannon divergence
- computational learning theory
- bregman divergences
- relative entropy
- kl divergence
- image processing
- feature selection