Information-Theoretic Lower Bounds for Zero-Order Stochastic Gradient Estimation.
Abdulrahman AlabdulkareemJean HonorioPublished in: CoRR (2020)
Keyphrases
- information theoretic
- lower bound
- mutual information
- information theory
- gradient estimation
- log likelihood
- theoretic framework
- information bottleneck
- upper bound
- worst case
- probabilistic model
- relative entropy
- jensen shannon divergence
- information theoretic measures
- markov random field
- convex hull
- optimal solution
- kl divergence