Does Standard Backpropagation Forget Less Catastrophically Than Adam?
Dylan R. AshleySina GhiassianRichard S. SuttonPublished in: CoRR (2021)
Keyphrases
- back propagation
- neural network
- artificial neural networks
- feed forward
- training algorithm
- feed forward neural networks
- neural nets
- hidden layer
- backpropagation neural networks
- bp algorithm
- multilayer perceptron
- bp neural network
- feedforward neural networks
- learning algorithm
- trained neural network
- cascade correlation
- fuzzy logic
- radial basis
- multilayer perceptron neural network
- backpropagation algorithm
- backpropagation neural network
- weight update
- activation function
- connection weights
- error back propagation
- knowledge base