Information-Theoretic Probing for Linguistic Structure.
Tiago PimentelJosef ValvodaRowan Hall MaudslayRan ZmigrodAdina WilliamsRyan CotterellPublished in: ACL (2020)
Keyphrases
- information theoretic
- information theory
- mutual information
- theoretic framework
- log likelihood
- jensen shannon divergence
- information bottleneck
- kullback leibler divergence
- relative entropy
- information theoretic measures
- minimum description length
- kl divergence
- computational learning theory
- pattern recognition
- multi modality
- geometric structure
- multi modal
- natural language processing
- computer vision
- machine learning