An Information-Theoretic Perspective on Overfitting and Underfitting.
Daniel BashirGeorge D. MontañezSonia SehraPedro Sandoval SeguraJulius LauwPublished in: CoRR (2020)
Keyphrases
- information theoretic
- information theory
- mutual information
- theoretic framework
- information theoretic measures
- information bottleneck
- jensen shannon divergence
- relative entropy
- minimum description length
- kl divergence
- multi modality
- decision trees
- kullback leibler divergence
- log likelihood
- entropy measure
- cross validation
- feature space
- similarity measure