Information-Theoretic Foundations for Machine Learning.
Hong Jun JeonBenjamin Van RoyPublished in: CoRR (2024)
Keyphrases
- information theoretic
- machine learning
- information theory
- mutual information
- theoretic framework
- information theoretic measures
- information bottleneck
- relative entropy
- machine learning algorithms
- machine learning methods
- pattern recognition
- jensen shannon divergence
- log likelihood
- support vector machine
- text classification
- entropy measure
- learning problems
- learning algorithm
- computational learning theory
- multi modality
- kl divergence
- kullback leibler divergence
- minimum description length
- data mining
- model selection
- computer vision
- information extraction
- active learning
- image segmentation
- kernel methods
- decision trees
- feature selection
- text mining
- image registration