SGD with Partial Hessian for Deep Neural Networks Optimization.
Ying SunHongwei YongLei ZhangPublished in: CoRR (2024)
Keyphrases
- neural network
- stochastic gradient descent
- optimization algorithm
- pattern recognition
- back propagation
- optimization problems
- global optimization
- stochastic gradient
- constrained optimization
- optimization process
- feed forward
- artificial neural networks
- fuzzy logic
- step size
- highly non linear
- hessian matrix
- fault diagnosis
- multilayer perceptron
- associative memory
- neural nets
- least squares
- multi layer
- data sets
- training set
- optimization model
- feature space
- decision trees
- combinatorial optimization