Bucketing Coding and Information Theory for the Statistical High Dimensional Nearest Neighbor Problem
Moshe DubinerPublished in: CoRR (2008)
Keyphrases
- information theory
- high dimensional
- nearest neighbor
- information theoretic
- rate distortion theory
- high dimensional data
- nearest neighbor search
- jensen shannon divergence
- conditional entropy
- low dimensional
- statistical learning
- data points
- statistical mechanics
- coding scheme
- dimensionality reduction
- data sets
- mdl principle
- knn
- shannon entropy
- information geometry
- variable selection
- similarity search
- coding method
- mutual information
- kullback leibler divergence
- statistical models
- training set
- computer vision
- inter frame