Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks.
Hristo PapazovScott PesmeNicolas FlammarionPublished in: CoRR (2024)
Keyphrases
- linear svm
- recurrent networks
- markov chain
- network design
- social networks
- training set
- markov processes
- learning rate
- network analysis
- optimal control
- complex systems
- closed form
- network structure
- deeper understanding
- linear systems
- linear constraints
- cellular networks
- spatial filters
- small world
- network topologies
- echo state networks
- machine learning
- training phase
- training algorithm
- covariance matrix
- dynamical systems
- test set
- training samples
- online learning
- supervised learning
- object detection
- state space
- training data
- learning algorithm