Nearest-neighbor entropy estimators with weak metrics.
Evgeniy A. TimofeevAlexei KaltchenkoPublished in: Adv. Math. Commun. (2014)
Keyphrases
- nearest neighbor
- knn
- k nearest neighbor
- entropy measure
- distance function
- high dimensional
- high dimensional data
- information theoretic
- nearest neighbor search
- nearest neighbor algorithm
- information theory
- mutual information
- training set
- similarity metrics
- evaluation metrics
- data points
- information entropy
- relative entropy
- evaluation methods
- information gain
- information content
- decision trees
- analytical expressions
- variance estimator