Rényi Cross-Entropy Measures for Common Distributions and Processes with Memory.

Ferenc Cole Thierrin Fady Alajaji Tamás Linder

Published in: CoRR (2022)

Keyphrases

cross entropy
evaluation metrics
shannon entropy
log likelihood
maximum likelihood
random variables
language modeling
error function
learning algorithm
mutual information
em algorithm
precision and recall
kl divergence