Ultra-Low Precision 4-bit Training of Deep Neural Networks.
Xiao SunNaigang WangChia-Yu ChenJiamin NiAnkur AgrawalXiaodong CuiSwagath VenkataramaniKaoutar El MaghraouiVijayalakshmi SrinivasanKailash GopalakrishnanPublished in: NeurIPS (2020)
Keyphrases
- neural network
- training process
- training algorithm
- feed forward neural networks
- feedforward neural networks
- multi layer perceptron
- fuzzy logic
- back propagation
- error back propagation
- backpropagation algorithm
- pattern recognition
- training phase
- deep architectures
- high speed
- test set
- neural network training
- supervised learning
- artificial neural networks
- training set
- genetic algorithm
- training patterns
- multilayer perceptron
- multi layer
- recurrent neural networks
- neural network model
- fault diagnosis
- expert systems
- machine learning
- radial basis function network
- recurrent networks
- self organizing maps