Finding Skill Neurons in Pre-trained Transformer-based Language Models.
Xiaozhi WangKaiyue WenZhengyan ZhangLei HouZhiyuan LiuJuanzi LiPublished in: CoRR (2022)
Keyphrases
- language model
- pre trained
- language modeling
- document retrieval
- n gram
- probabilistic model
- retrieval model
- test collection
- query expansion
- speech recognition
- information retrieval
- language modelling
- neural network
- language models for information retrieval
- statistical language models
- smoothing methods
- training data
- relevance model
- graph cuts
- information retrieval systems
- dimensionality reduction
- document ranking