Robust Learning Rate Selection for Stochastic Optimization via Splitting Diagnostic.
Matteo SordelloWeijie SuPublished in: CoRR (2019)
Keyphrases
- stochastic optimization
- learning rate
- robust optimization
- multistage
- convergence rate
- rapid convergence
- convergence speed
- error function
- learning algorithm
- multilayer neural networks
- adaptive learning rate
- evolutionary algorithm
- bp neural network algorithm
- convergence theorem
- activation function
- sufficient conditions
- particle swarm optimization