SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networks.
Rui-Jie ZhuQihang ZhaoGuoqi LiJason EshraghianPublished in: Trans. Mach. Learn. Res. (2024)
Keyphrases
- language model
- pre trained
- spiking neural networks
- biologically inspired
- language modeling
- training data
- probabilistic model
- generative model
- n gram
- learning rules
- language modeling framework
- speech recognition
- feed forward
- artificial neural networks
- training examples
- biologically plausible
- information retrieval
- control signals
- neural network
- query expansion
- unsupervised learning
- smoothing methods
- training algorithm
- back propagation
- video sequences
- data mining