Adam Induces Implicit Weight Sparsity in Rectifier Neural Networks.
Atsushi YaguchiTaiji SuzukiWataru AsanoShuhei NittaYukinobu SakataAkiyuki TanizawaPublished in: ICMLA (2018)
Keyphrases
- neural network
- weight update
- pattern recognition
- sparse representation
- high dimensional
- neural network model
- fuzzy logic
- fault diagnosis
- artificial neural networks
- genetic algorithm
- neural nets
- back propagation
- multilayer perceptron
- activation function
- weighting scheme
- weight vector
- synaptic weights
- real time
- associative memory
- self organizing maps