Information-Theoretic Bounds on the Generalization Error and Privacy Leakage in Federated Learning.
Semih YagliAlex DytsoH. Vincent PoorPublished in: SPAWC (2020)
Keyphrases
- information theoretic
- generalization error
- learning algorithm
- learning machines
- upper bound
- mutual information
- information theory
- information bottleneck
- supervised learning
- active learning
- lower bound
- cross validation
- learning process
- learning problems
- theoretic framework
- inductive inference
- generalization error bounds
- training error
- entropy measure
- sample size
- feature space
- training data
- computer vision