The Estimation of Distributions and the Minimum Relative Entropy Principle.
Heinz MühlenbeinRobin HönsPublished in: Evol. Comput. (2005)
Keyphrases
- relative entropy
- bregman divergences
- kullback leibler divergence
- exponential family
- log likelihood
- kl divergence
- information theoretic
- information theory
- mutual information
- mahalanobis distance
- probability density
- maximum entropy
- density estimation
- probability distribution
- covariance matrix
- loss function
- decision trees
- gaussian mixture model
- theoretical guarantees
- upper bound