Approximate Sparsity Pattern Recovery: Information-Theoretic Lower Bounds
Galen ReevesMichael GastparPublished in: CoRR (2010)
Keyphrases
- information theoretic
- lower bound
- information theory
- mutual information
- upper bound
- theoretic framework
- information bottleneck
- information theoretic measures
- log likelihood
- high dimensional
- jensen shannon divergence
- multi modality
- relative entropy
- kullback leibler divergence
- entropy measure
- image analysis
- distributional clustering
- minimum description length
- computational learning theory
- similarity measure
- nearest neighbor