Does dirichlet prior smoothing solve the Shannon entropy estimation problem?

Yanjun Han Jiantao Jiao Tsachy Weissman

Published in: ISIT (2015)

Keyphrases

dirichlet prior
shannon entropy
mixture model
language model
information theory
language modeling
density estimation
smoothing methods
dirichlet distribution
distance measure
maximum likelihood
parameter estimation