Super-Convergence: Very Fast Training of Residual Networks Using Large Learning Rates.
Leslie N. SmithNicholay TopinPublished in: CoRR (2017)
Keyphrases
- learning rate
- convergence rate
- adaptive learning rate
- convergence theorem
- rapid convergence
- convergence speed
- backpropagation algorithm
- learning algorithm
- update rule
- hidden layer
- feed forward neural networks
- gaussian kernels
- training examples
- weight vector
- neural network
- cross validation
- back propagation
- covering numbers
- training samples
- high dimensional
- supervised learning
- feedforward neural networks
- loss function
- training set
- machine learning