A simple information theoretic proof of the maximum entropy property of some Gaussian random fields.
Dimitris Nicolas PolitisPublished in: IEEE Trans. Image Process. (1994)
Keyphrases
- maximum entropy
- random fields
- information theoretic
- mutual information
- information theory
- bregman divergences
- maximum entropy principle
- conditional random fields
- marginal distributions
- markov models
- probabilistic logic
- markov random field
- kullback leibler divergence
- joint distribution
- competitive learning
- parameter estimation
- log likelihood
- kl divergence
- mixture model
- higher order
- image registration
- probabilistic model
- hidden markov models