An Information-Theoretic Perspective on Overfitting and Underfitting.
Daniel BashirGeorge D. MontañezSonia SehraPedro Sandoval SeguraJulius LauwPublished in: Australasian Conference on Artificial Intelligence (2020)
Keyphrases
- information theoretic
- mutual information
- information theory
- theoretic framework
- information bottleneck
- information theoretic measures
- entropy measure
- cross validation
- jensen shannon divergence
- relative entropy
- minimum description length
- kullback leibler divergence
- log likelihood
- decision trees
- computational learning theory
- multi modality
- data mining
- text mining
- pattern recognition