The Differential Entropy of Mixtures: New Bounds and Applications.
James MelbourneSaurav TalukdarShreyas BhabanMokshay MadimanMurti V. SalapakaPublished in: IEEE Trans. Inf. Theory (2022)
Keyphrases
- upper bound
- mixture model
- lower bound
- worst case
- information theoretic
- mixtures of gaussians
- upper and lower bounds
- mutual information
- information theory
- conditional entropy
- error bounds
- expectation maximization
- information entropy
- gaussian mixture
- factor analyzers
- kullback leibler divergence
- vc dimension
- relative entropy
- fuzzy entropy
- database
- minimum error
- shannon entropy
- information content
- expected loss
- optimal solution