The Convergence Rate of Neural Networks for Learned Functions of Different Frequencies.
Ronen BasriDavid W. JacobsYoni KastenShira KritchmanPublished in: CoRR (2019)
Keyphrases
- convergence rate
- neural network
- learning rate
- step size
- convergence speed
- gradient method
- global convergence
- wavelet neural network
- primal dual
- fuzzy logic
- mutation operator
- numerical stability
- neural network model
- artificial neural networks
- back propagation
- faster convergence rate
- variable step size
- lp norm
- training algorithm
- particle swarm optimization algorithm