Normalization Layers Are All That Sharpness-Aware Minimization Needs.
Maximilian MüllerTiffany VlaarDavid RolnickMatthias HeinPublished in: NeurIPS (2023)
Keyphrases
- multi layer
- objective function
- multiple layers
- minimization problems
- regularization term
- information content
- convex minimization
- efficient optimization
- edge preserving
- preprocessing
- search engine
- cost function
- databases
- quality assessment
- knowledge base
- feature selection
- single layer
- information systems
- normalization method
- learning algorithm
- genetic algorithm