Luck Matters: Understanding Training Dynamics of Deep ReLU Networks.
Yuandong TianTina JiangQucheng GongAri S. MorcosPublished in: CoRR (2019)
Keyphrases
- recurrent networks
- recurrent neural networks
- social networks
- network structure
- network design
- training process
- training samples
- neural network
- online learning
- training set
- heterogeneous networks
- feature selection
- echo state networks
- training examples
- dynamical systems
- feed forward
- supervised learning
- training algorithm