Mixing ADAM and SGD: a Combined Optimization Method.
Nicola LandroIgnazio GalloRiccardo La GrassaPublished in: CoRR (2020)
Keyphrases
- optimization method
- optimization algorithm
- optimization methods
- differential evolution
- optimization process
- genetic algorithm
- optimization procedure
- simulated annealing
- evolutionary algorithm
- nelder mead simplex
- global optimum
- metaheuristic
- particle swarm
- nonlinear optimization
- search algorithm
- optimization strategy
- hybrid algorithm
- computational intelligence
- multi objective
- closed form
- optimization problems
- particle swarm optimization pso
- bayesian networks
- stochastic gradient descent
- neural network