Sign in

Universal Sharpness Dynamics in Neural Network Training: Fixed Point Analysis, Edge of Stability, and Route to Chaos.

Dayal Singh KalraTianyu HeMaissam Barkeshli
Published in: CoRR (2023)
Keyphrases
  • fixed point
  • neural network training
  • neural network
  • dynamical systems
  • floating point
  • artificial neural networks
  • optimization problems
  • graphical models
  • recurrent neural networks
  • initial conditions