Component-Wise Natural Gradient Descent - An Efficient Neural Network Optimization.
Tran Van SangMhd IrvanRie Shigetomi YamaguchiToshiyuki NakataPublished in: CoRR (2022)
Keyphrases
- neural network
- image reconstruction from projections
- cost function
- artificial neural networks
- neural network model
- back propagation
- genetic algorithm
- highly non linear
- optimization algorithm
- optimization method
- combinatorial optimization
- optimization problems
- software components
- learning rules
- discrete optimization
- stochastic gradient descent
- iterative methods
- real world
- loss function
- power system
- hopfield neural network
- learning vector quantization
- stochastic gradient
- data sets