Finding Skill Neurons in Pre-trained Transformer-based Language Models.
Xiaozhi WangKaiyue WenZhengyan ZhangLei HouZhiyuan LiuJuanzi LiPublished in: EMNLP (2022)
Keyphrases
- language model
- pre trained
- language modeling
- language modelling
- probabilistic model
- n gram
- information retrieval
- document retrieval
- speech recognition
- retrieval model
- smoothing methods
- statistical language models
- test collection
- training data
- query expansion
- relevance model
- neural network
- document ranking
- text mining
- pairwise
- bayesian networks