Neurons in Large Language Models: Dead, N-gram, Positional.
Elena VoitaJavier FerrandoChristoforos NalmpantisPublished in: ACL (Findings) (2024)
Keyphrases
- language model
- n gram
- language modeling
- probabilistic model
- language modelling
- neural network
- bag of words
- language independent
- document retrieval
- test collection
- information retrieval
- speech recognition
- retrieval model
- vector space model
- query expansion
- context sensitive
- part of speech
- passage retrieval
- document ranking
- smoothing methods
- query terms
- pseudo relevance feedback
- term dependencies
- statistical language modeling
- cross lingual