Training Neural Networks with Fixed Sparse Masks.
Yi-Lin SungVarun NairColin RaffelPublished in: NeurIPS (2021)
Keyphrases
- neural network
- training process
- training algorithm
- feed forward neural networks
- multi layer perceptron
- feedforward neural networks
- pattern recognition
- neural network training
- backpropagation algorithm
- artificial neural networks
- neural network structure
- back propagation
- test set
- training set
- fuzzy neural network
- avoid overfitting
- training patterns
- radial basis function network
- multilayer neural network
- sparse data
- genetic algorithm
- activation function
- supervised learning
- fuzzy logic
- high dimensional
- training phase
- recurrent neural networks
- reduced set
- sparse matrix
- recurrent networks
- dictionary learning
- multi layer
- restricted boltzmann machine
- sparse representation
- online learning
- object detection