Information-Theoretic Generalization Bounds for Deep Neural Networks.
Haiyun HeChristina Lee YuZiv GoldfeldPublished in: CoRR (2024)
Keyphrases
- information theoretic
- generalization bounds
- neural network
- data dependent
- learning theory
- mutual information
- generalization ability
- information theory
- ranking algorithm
- vc dimension
- linear classifiers
- model selection
- artificial neural networks
- statistical learning theory
- learning problems
- pattern recognition
- fault diagnosis
- back propagation
- cross validation
- inductive inference
- bp neural network
- neural network model
- active learning
- upper bound
- image registration
- kernel machines
- ranking functions