Estimating the Entropy of Linguistic Distributions.
Aryaman AroraClara MeisterRyan CotterellPublished in: CoRR (2022)
Keyphrases
- cumulative residual entropy
- probability distribution
- natural language processing
- information theory
- kullback leibler divergence
- natural language
- mutual information
- random variables
- shannon entropy
- power law
- databases
- learning algorithm
- rigid body
- information theoretic
- joint distribution
- information extraction
- accurate estimation
- data sets
- gaussian model
- kl divergence
- estimation process
- exponential distributions
- multi class