Uniform convergence may be unable to explain generalization in deep learning.
Vaishnavh NagarajanJ. Zico KolterPublished in: CoRR (2019)
Keyphrases
- deep learning
- uniform convergence
- generalization bounds
- sufficient conditions
- unsupervised learning
- machine learning
- learning rate
- reproducing kernel hilbert space
- risk minimization
- statistical learning theory
- learning theory
- generalization ability
- vc dimension
- real valued
- mental models
- learning problems
- data dependent
- model selection
- multiscale
- generalization error
- weakly supervised
- information retrieval
- lower bound
- prior knowledge
- sample complexity
- ranking functions
- inductive inference
- upper bound
- object recognition
- reinforcement learning
- higher order