Adam Induces Implicit Weight Sparsity in Rectifier Neural Networks.
Atsushi YaguchiTaiji SuzukiWataru AsanoShuhei NittaYukinobu SakataAkiyuki TanizawaPublished in: CoRR (2018)
Keyphrases
- neural network
- weight update
- genetic algorithm
- pattern recognition
- back propagation
- fault diagnosis
- neural network model
- artificial neural networks
- high dimensional
- feed forward
- multilayer perceptron
- multi layer
- sparse representation
- recurrent neural networks
- image classification
- control system
- real time
- radial basis function
- sparsity constraints
- weight assignment