A Finite-Sample, Distribution-Free, Probabilistic Lower Bound on Mutual Information.
Nathan D. VanderKraatsArunava BanerjeePublished in: Neural Comput. (2011)
Keyphrases
- distribution free
- mutual information
- lower bound
- vc dimension
- concept class
- parzen window
- statistical learning theory
- information theoretic
- upper bound
- learning theory
- sample complexity
- generalization bounds
- concept classes
- sample size
- similarity measure
- large deviations
- image registration
- normal distribution
- probabilistic model
- feature selection
- np hard
- bayesian networks
- generative model
- worst case
- optimal solution
- membership queries
- uniform distribution
- gaussian mixture model
- theoretical analysis
- nearest neighbor
- queueing systems
- machine learning