Information-Theoretic Probing for Linguistic Structure.

Tiago Pimentel Josef Valvoda Rowan Hall Maudslay Ran Zmigrod Adina Williams Ryan Cotterell

Published in: CoRR (2020)

Keyphrases

information theoretic
mutual information
information theory
theoretic framework
information bottleneck
information theoretic measures
entropy measure
log likelihood
minimum description length
relative entropy
kullback leibler divergence
jensen shannon divergence
machine learning
multi modality
jensen shannon