A scalable second order optimizer with an adaptive trust region for neural networks.
Donghee YangJunhyun ChoSungchul LeePublished in: Neural Networks (2023)
Keyphrases
- trust region
- neural network
- hessian matrix
- levenberg marquardt
- optimization methods
- global optimum
- column generation
- back propagation
- log likelihood
- artificial neural networks
- step size
- newton method
- line search
- optimization algorithm
- fuzzy logic
- genetic algorithm
- linear programming
- optimization method
- least squares
- hidden layer
- gaussian derivatives
- multi objective
- optimization problems