A Rigorous Information-Theoretic Definition of Redundancy and Relevancy in Feature Selection Based on (Partial) Information Decomposition.
Patricia WollstadtSebastian SchmittMichael WibralPublished in: CoRR (2021)
Keyphrases
- information theoretic
- partial information
- mutual information
- feature selection
- information theory
- incomplete information
- theoretic framework
- jensen shannon divergence
- information bottleneck
- information theoretic measures
- machine learning
- text categorization
- distributional clustering
- multi modality
- feature selection algorithms
- multi class
- kullback leibler divergence
- relative entropy
- image registration
- log likelihood
- support vector
- feature extraction
- feature space
- entropy measure
- minimum description length
- jensen shannon
- selection criterion
- feature subset
- model selection
- similarity measure
- text classification
- feature set
- support vector machine
- dynamic programming