ELRA: Exponential learning rate adaption gradient descent optimization method.
Alexander KleinsorgeStefan KupperAlexander FauckFelix RothePublished in: CoRR (2023)
Keyphrases
- optimization method
- learning rate
- error function
- update rule
- natural gradient
- differential evolution
- convergence speed
- optimization algorithm
- optimization methods
- optimization process
- simulated annealing
- convergence rate
- genetic algorithm
- learning algorithm
- evolutionary algorithm
- hidden layer
- optimization procedure
- cost function
- particle swarm
- global optimum
- adaptive learning rate
- metaheuristic
- rapid convergence
- activation function
- multilayer neural networks
- conjugate gradient
- particle swarm optimization
- nonlinear optimization
- objective function
- pso algorithm
- nelder mead simplex
- training algorithm
- hybrid algorithm
- weight vector
- multi objective
- particle swarm optimization algorithm
- convergence theorem
- step size
- delta bar delta
- neural network