Optimization Theory for ReLU Neural Networks Trained with Normalization Layers.
Yonatan DuklerQuanquan GuGuido MontúfarPublished in: ICML (2020)
Keyphrases
- neural network
- multi layer
- multilayer perceptron
- multi layer perceptron
- pattern recognition
- back propagation
- training process
- preprocessing
- optimization problems
- genetic algorithm
- auto associative
- global optimization
- optimization algorithm
- trained neural networks
- trained neural network
- theoretical framework
- optimization method
- neural network model
- backpropagation algorithm
- evolutionary algorithm
- training data
- optimization process
- single layer
- feed forward neural networks
- multilayer neural network
- theoretical basis
- fuzzy neural network
- recurrent neural networks
- feed forward
- fuzzy logic
- feature selection
- learning algorithm