Tight Bounds on the Rényi Entropy via Majorization with Applications to Guessing and Compression.
Igal SasonPublished in: Entropy (2018)
Keyphrases
- tight bounds
- shannon entropy
- upper bound
- information theory
- compression algorithm
- compression scheme
- information theoretic
- compression ratio
- data compression
- mutual information
- image compression
- lower bound
- adaptive binary arithmetic coding
- relative entropy
- compression rate
- artificial intelligence
- information systems
- conditional entropy
- data sets
- image sequences
- information entropy
- kl divergence
- machine learning
- minimum error
- real world