Some Order Preserving Inequalities for Cross Entropy and Kullback-Leibler Divergence.
Mateu SbertMin ChenJordi PochAnton BarderaPublished in: Entropy (2018)
Keyphrases
- kullback leibler divergence
- cross entropy
- order preserving
- information theoretic
- log likelihood
- mutual information
- information theory
- maximum likelihood
- probability density function
- distance measure
- hash functions
- language modeling
- evaluation metrics
- ranking functions
- marginal distributions
- data sets
- feature selection
- learning algorithm
- machine learning
- neural network
- language model
- image segmentation