Information theoretic perspective on sample complexity.
Deborah PeregPublished in: Neural Networks (2023)
Keyphrases
- information theoretic
- sample complexity
- information theory
- mutual information
- theoretical analysis
- learning problems
- special case
- vc dimension
- pac learning
- generalization error
- upper bound
- active learning
- learning algorithm
- theoretic framework
- supervised learning
- lower bound
- jensen shannon divergence
- computational learning theory
- information bottleneck
- information theoretic measures
- training examples
- sample size
- learning tasks
- training data
- similarity measure
- decision trees