The Effects of Mild Over-parameterization on the Optimization Landscape of Shallow ReLU Neural Networks.
Itay SafranGilad YehudaiOhad ShamirPublished in: CoRR (2020)
Keyphrases
- neural network
- highly non linear
- optimization problems
- pattern recognition
- optimization process
- discrete optimization
- constrained optimization
- fuzzy logic
- optimization algorithm
- fault diagnosis
- optimization method
- data sets
- training process
- recurrent neural networks
- global optimization
- combinatorial optimization
- fuzzy rules
- back propagation
- multi layer
- information retrieval
- information extraction
- support vector machine
- evolution strategy
- information systems
- search algorithm