From Mutual Information to Expected Dynamics: New Generalization Bounds for Heavy-Tailed SGD.
Benjamin DupuisPaul ViallardPublished in: CoRR (2023)
Keyphrases
- heavy tailed
- mutual information
- generalization bounds
- learning theory
- data dependent
- generalization ability
- model selection
- information theoretic
- generalized gaussian
- statistical learning theory
- similarity measure
- vc dimension
- linear classifiers
- image registration
- ranking algorithm
- learning problems
- feature selection
- kullback leibler divergence
- cross validation
- support vector
- information theory
- prior distribution
- training set