Mutual Information, Relative Entropy and Estimation Error in Semi-Martingale Channels.
Jiantao JiaoKartik VenkatTsachy WeissmanPublished in: IEEE Trans. Inf. Theory (2018)
Keyphrases
- relative entropy
- mutual information
- estimation error
- information theoretic
- covariance matrix
- image registration
- average error
- kullback leibler divergence
- similarity measure
- feature selection
- standard deviation
- information theory
- error rate
- log likelihood
- step size
- kl divergence
- image compression
- dimensionality reduction
- principal component analysis