An entropy inequality for q-ary random variables and its application to channel polarization.
Eren SasogluPublished in: ISIT (2010)
Keyphrases
- kullback leibler divergence
- random variables
- marginal distributions
- mutual information
- information theory
- probability distribution
- probability density
- information theoretic
- graphical models
- joint distribution
- bayesian networks
- conditional independence
- latent variables
- multi channel
- stochastic optimization problems
- normal distribution
- conditional probabilities
- random vectors
- stochastic processes
- independent and identically distributed
- conditional distribution
- distribution function
- conditional probability distributions
- conditional distributions
- conditionally independent
- identically distributed
- probabilistic model
- directed acyclic graph