A Bayesian Framework for Information-Theoretic Probing.
Tiago PimentelRyan CotterellPublished in: EMNLP (1) (2021)
Keyphrases
- information theoretic
- bayesian framework
- information theory
- mutual information
- prior knowledge
- posterior probability
- information bottleneck
- generative model
- theoretic framework
- probability density function
- gaussian process
- expectation maximization
- posterior distribution
- hyperparameters
- maximum a posteriori
- kullback leibler divergence
- jensen shannon divergence
- bayesian formulation
- kl divergence
- maximum likelihood
- high resolution
- similarity measure
- entropy measure