Provable Accelerated Convergence of Nesterov's Momentum for Deep ReLU Neural Networks.
Fangshuo LiaoAnastasios KyrillidisPublished in: ALT (2024)
Keyphrases
- neural network
- weight update
- learning rate
- semidefinite programming
- pattern recognition
- neural network model
- convergence rate
- artificial neural networks
- fuzzy logic
- back propagation
- genetic algorithm
- neural nets
- machine learning
- convex concave
- activation function
- self organizing maps
- convergence speed
- recurrent neural networks
- multilayer perceptron
- rule extraction
- structured prediction
- deep learning
- fault diagnosis
- feature selection