Feature selection in machine learning: Rényi min-entropy vs Shannon entropy.
Catuscia PalamidessiMarco RomanelliPublished in: CoRR (2020)
Keyphrases
- shannon entropy
- feature selection
- machine learning
- mutual information
- information theory
- text categorization
- information theoretic
- text classification
- dimensionality reduction
- gini index
- unsupervised learning
- model selection
- support vector
- computer vision
- machine learning methods
- semi supervised learning
- feature space
- active learning
- knn
- information extraction
- image registration
- natural language processing
- feature extraction
- feature ranking
- kl divergence
- supervised learning
- bayesian networks
- learning tasks
- image processing