Neurons in Large Language Models: Dead, N-gram, Positional.
Elena VoitaJavier FerrandoChristoforos NalmpantisPublished in: CoRR (2023)
Keyphrases
- language model
- n gram
- language modeling
- language independent
- language modelling
- document retrieval
- neural network
- information retrieval
- speech recognition
- probabilistic model
- bag of words
- retrieval model
- query expansion
- test collection
- context sensitive
- smoothing methods
- part of speech
- translation model
- word segmentation
- vector space model
- pseudo relevance feedback
- relevance model
- word level