The Convergence Rate of Neural Networks for Learned Functions of Different Frequencies.
Ronen BasriDavid W. JacobsYoni KastenShira KritchmanPublished in: NeurIPS (2019)
Keyphrases
- convergence rate
- neural network
- step size
- learning rate
- convergence speed
- mutation operator
- primal dual
- numerical stability
- global convergence
- neural network model
- artificial neural networks
- wavelet neural network
- recurrent neural networks
- gradient method
- genetic algorithm
- training algorithm
- image denoising
- nonlinear functions
- optimal solution