Surprising Instabilities in Training Deep Networks and a Theoretical Analysis.
Yuxin SunDong LaoGanesh SundaramoorthiAnthony J. YezziPublished in: CoRR (2022)
Keyphrases
- theoretical analysis
- numerical simulations
- social networks
- recurrent networks
- network structure
- neural network
- training process
- network analysis
- test set
- training samples
- training set
- recurrent neural networks
- semi supervised
- echo state networks
- training examples
- online learning
- supervised learning
- computer networks
- training algorithm
- network design
- feedforward neural networks
- real time
- deep architectures