Rényi Cross-Entropy Measures for Common Distributions and Processes with Memory.
Ferenc Cole ThierrinFady AlajajiTamás LinderPublished in: Entropy (2022)
Keyphrases
- cross entropy
- evaluation metrics
- log likelihood
- maximum likelihood
- shannon entropy
- probability distribution
- error function
- language modeling
- precision and recall
- information retrieval
- density estimation
- learning to rank
- probabilistic context free grammars
- random variables
- loss function
- supervised learning
- training data