A Generalization of Shannon's Mutual Information for Improved Feature Selection in Databases Involving Possibly Rare but Well-Predictable Classes.
Olcay KursunPublished in: Artificial Intelligence and Pattern Recognition (2008)
Keyphrases
- mutual information
- feature selection
- databases
- information theoretic
- conditional mutual information
- shannon entropy
- information theory
- information gain
- image registration
- similarity measure
- feature space
- kullback leibler divergence
- medical image registration
- feature extraction
- database
- machine learning
- text categorization
- information theoretic measures
- classification accuracy
- feature selection algorithms
- database applications
- model selection
- selection criterion
- support vector machine
- data model
- information systems
- data warehouse
- mutual information maximization
- feature subset
- high dimensionality
- text classification
- knowledge discovery
- active learning
- high dimensional
- support vector
- database systems
- data sets