The Effects of Mild Over-parameterization on the Optimization Landscape of Shallow ReLU Neural Networks.
Itay M. SafranGilad YehudaiOhad ShamirPublished in: COLT (2021)
Keyphrases
- neural network
- highly non linear
- fuzzy logic
- pattern recognition
- optimization model
- artificial neural networks
- information extraction
- global optimization
- discrete optimization
- natural language processing
- optimization problems
- optimization algorithm
- question answering
- optimization process
- feed forward
- data mining
- recurrent neural networks
- combinatorial optimization
- optimization method
- genetic algorithm
- fuzzy systems
- fault diagnosis
- constrained optimization
- multi layer perceptron
- case study
- cellular neural networks
- learning algorithm