Convergence Analyses of Online ADAM Algorithm in Convex Setting and Two-Layer ReLU Neural Network.
Biyi FangDiego KlabjanPublished in: CoRR (2019)
Keyphrases
- neural network
- cost function
- learning algorithm
- simulated annealing
- dynamic programming
- computational cost
- preprocessing
- np hard
- expectation maximization
- detection algorithm
- convergence rate
- optimal solution
- similarity measure
- training algorithm
- multi layer
- orthogonal basis
- adaptive learning rate
- single layer
- iterative algorithms
- semidefinite programming
- rbf network
- training process
- radial basis function
- optimization algorithm
- online learning
- linear programming
- worst case
- k means
- image segmentation