A Bayesian Framework for Information-Theoretic Probing.
Tiago PimentelRyan CotterellPublished in: CoRR (2021)
Keyphrases
- bayesian framework
- information theoretic
- mutual information
- information theory
- prior knowledge
- generative model
- theoretic framework
- hyperparameters
- information bottleneck
- information theoretic measures
- posterior probability
- gaussian process
- expectation maximization
- bayesian formulation
- posterior distribution
- maximum a posteriori
- probability density function
- entropy measure
- kullback leibler divergence
- image processing
- kl divergence
- relative entropy
- closed form
- parameter estimation