Global Convergence of Online BP Training With Dynamic Learning Rate.
Rui ZhangZongben XuGuang-Bin HuangDianhui WangPublished in: IEEE Trans. Neural Networks Learn. Syst. (2012)
Keyphrases
- learning rate
- global convergence
- convergence rate
- multilayer neural networks
- convergence speed
- bp algorithm
- training algorithm
- adaptive learning rate
- convergence analysis
- step size
- constrained optimization problems
- error function
- hidden layer
- learning algorithm
- global optimum
- weight vector
- globally convergent
- back propagation
- rapid convergence
- conjugate gradient
- convergence theorem
- differential evolution
- line search
- bp neural network algorithm
- convex minimization
- particle swarm optimization algorithm
- optimization methods
- newton method
- global optimization
- optimization algorithm
- computational intelligence
- machine learning
- activation function