A Rigorous Information-Theoretic Definition of Redundancy and Relevancy in Feature Selection Based on (Partial) Information Decomposition.
Patricia WollstadtSebastian SchmittMichael WibralPublished in: J. Mach. Learn. Res. (2023)
Keyphrases
- information theoretic
- partial information
- mutual information
- feature selection
- information theory
- incomplete information
- theoretic framework
- jensen shannon divergence
- information bottleneck
- information theoretic measures
- multi modality
- relative entropy
- distributional clustering
- feature selection algorithms
- similarity measure
- log likelihood
- feature extraction
- kullback leibler divergence
- text categorization
- entropy measure
- dimensionality reduction
- image registration
- text classification
- classification accuracy
- feature subset
- probability density function
- model selection