Concentration Bounds for Discrete Distribution Estimation in KL Divergence.
Clément L. CanonneZiteng SunAnanda Theertha SureshPublished in: CoRR (2023)
Keyphrases
- kl divergence
- probability density
- kullback leibler
- kullback leibler divergence
- exponential family
- mahalanobis distance
- information theoretic
- gaussian distribution
- density estimation
- gaussian mixture
- lower bound
- posterior distribution
- maximum likelihood estimation
- upper bound
- mutual information
- probability distribution
- gaussian mixture model
- maximum likelihood
- mixture model
- probability density function
- parameter estimation
- translation model
- random variables
- log likelihood
- bayesian inference
- language model