SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networks.
Rui-Jie ZhuQihang ZhaoJason K. EshraghianPublished in: CoRR (2023)
Keyphrases
- language model
- pre trained
- spiking neural networks
- biologically inspired
- language modeling
- generative model
- probabilistic model
- learning rules
- training data
- language modeling framework
- n gram
- feed forward
- training examples
- speech recognition
- query expansion
- artificial neural networks
- biologically plausible
- information retrieval
- neural network
- control signals
- training algorithm
- smoothing methods
- unsupervised learning
- feature selection
- computer vision
- data sets
- input image
- training set
- machine learning