SpikeLLM: Scaling up Spiking Neural Network to Large Language Models via Saliency-based Spiking.
Xingrun XingBoyan GaoZheng ZhangDavid A. CliftonShitao XiaoLi DuGuoqi LiJiajun ZhangPublished in: CoRR (2024)
Keyphrases
- language model
- spiking neural networks
- biologically inspired
- language modeling
- feed forward
- spiking neurons
- learning rules
- n gram
- visual attention
- probabilistic model
- cerebellar model
- document retrieval
- hebbian learning
- artificial neural networks
- retrieval model
- query expansion
- saliency map
- language modelling
- biologically plausible
- information retrieval
- test collection
- neural network
- neuron model
- training algorithm
- motor control
- document ranking
- visual search
- receptive fields
- statistical language models
- back propagation
- language models for information retrieval
- biological systems
- smoothing methods