Zipf's law, hyperbolic distributions and entropy loss.
Peter HarremoësFlemming TopsøePublished in: Electron. Notes Discret. Math. (2005)
Keyphrases
- power law
- cumulative residual entropy
- kullback leibler divergence
- information theory
- probability distribution
- mutual information
- information theoretic
- data sets
- heavy tailed distributions
- shannon entropy
- gaussian distribution
- information content
- random variables
- legal reasoning
- relative entropy
- maximum likelihood
- loss probability
- expected loss
- exponential distributions
- information retrieval
- real time