GradInit: Learning to Initialize Neural Networks for Stable and Efficient Training.
Chen ZhuRenkun NiZheng XuKezhi KongW. Ronny HuangTom GoldsteinPublished in: CoRR (2021)
Keyphrases
- neural network
- training process
- learning algorithm
- reinforcement learning
- pattern recognition
- learning process
- feedforward neural networks
- supervised learning
- online learning
- training algorithm
- mobile learning
- learning scheme
- neural nets
- learning problems
- learning systems
- learning rules
- knowledge acquisition
- learning speed
- genetic algorithm
- multi layer perceptron
- learning machines
- structured prediction
- training phase
- recurrent networks
- data sets
- connectionist systems
- learning tasks
- back propagation
- unsupervised learning
- collaborative learning
- active learning
- prior knowledge
- artificial neural networks
- training data
- machine learning