Memory-Efficient Backpropagation through Large Linear Layers.
Daniel BershatskyAleksandr MikhalevAlexandr KatrutsaJulia GusakDaniil MerkulovIvan V. OseledetsPublished in: CoRR (2022)
Keyphrases
- memory efficient
- back propagation
- artificial neural networks
- feed forward
- neural network
- training algorithm
- feedforward neural networks
- bp algorithm
- multilayer perceptron
- bp neural network
- feed forward neural networks
- backpropagation neural network
- hidden layer
- backpropagation neural networks
- neural nets
- learning algorithm
- fuzzy logic
- external memory
- iterative deepening
- trained neural network
- neural network ensemble
- multi layer
- single layer
- backpropagation algorithm
- multilayer perceptron neural network
- activation function
- levenberg marquardt
- rbf network
- error back propagation
- cascade correlation
- linear combination
- multi layer neural network