Implicit Bias of MSE Gradient Optimization in Underparameterized Neural Networks.
Benjamin BowmanGuido MontúfarPublished in: ICLR (2022)
Keyphrases
- neural network
- optimization process
- optimization problems
- global optimization
- artificial neural networks
- optimization algorithm
- optimization method
- constrained optimization
- back propagation
- image quality
- self organizing maps
- data sets
- pattern recognition
- multilayer perceptron
- recurrent neural networks
- fuzzy systems
- multiscale
- genetic algorithm
- training algorithm
- optimization model
- discrete optimization
- highly non linear