A Loss Curvature Perspective on Training Instabilities of Deep Learning Models.
Justin GilmerBehrooz GhorbaniAnkush GargSneha KuduguntaBehnam NeyshaburDavid CardozeGeorge Edward DahlZachary NadoOrhan FiratPublished in: ICLR (2022)
Keyphrases
- learning models
- learning algorithm
- machine learning
- loss function
- learning tasks
- semi supervised learning
- conditional random fields
- learning paradigms
- supervised learning
- classification models
- machine learning algorithms
- training set
- learning problems
- sparse metric learning
- training examples
- machine learning models
- information extraction
- active learning
- learning process
- reinforcement learning
- training data