Parameterless Stochastic Natural Gradient Method for Discrete Optimization and its Application to Hyper-Parameter Optimization for Neural Network.
Kouhei NishidaHernán E. AguirreShota SaitoShinichi ShirakawaYouhei AkimotoPublished in: CoRR (2018)
Keyphrases
- discrete optimization
- parameter optimization
- gradient method
- neural network
- genetic algorithm ga
- genetic algorithm
- combinatorial optimization problems
- convergence rate
- differential evolution
- parameter settings
- optimization methods
- support vector machine
- step size
- parameter estimation
- artificial neural networks
- negative matrix factorization
- pattern recognition
- back propagation
- optimization problems
- ant colony optimization
- pid controller
- convergence speed
- cost function
- multiscale
- knapsack problem
- combinatorial optimization
- evolutionary algorithm
- fault diagnosis
- metaheuristic
- high dimensional data
- simulated annealing
- markov random field