How to select an objective function using information theory.

Timothy O. Hodson Thomas M. Over Tyler J. Smith Lucy M. Marshall

Published in: CoRR (2022)

Keyphrases

information theory
objective function
information theoretic
statistical learning
jensen shannon divergence
statistical mechanics
conditional entropy
optimal solution
kullback leibler divergence
mutual information
mdl principle
rate distortion theory
pattern recognition
relative entropy
information geometry