Optimization Theory for ReLU Neural Networks Trained with Normalization Layers.
Yonatan DuklerQuanquan GuGuido MontúfarPublished in: CoRR (2020)
Keyphrases
- neural network
- multilayer perceptron
- multi layer
- training process
- single layer
- artificial neural networks
- trained neural networks
- multi layer perceptron
- optimization problems
- back propagation
- optimization process
- auto associative
- global optimization
- theoretical basis
- fuzzy systems
- pattern recognition
- trained neural network
- theoretical framework
- computational model
- fuzzy logic
- training set
- data sets
- machine learning
- general theory
- rule extraction
- knowledge base
- neural nets
- preprocessing
- optimization method
- expert systems