On the Multilingual Ability of Decoder-based Pre-trained Language Models: Finding and Controlling Language-Specific Neurons.
Takeshi KojimaItsuki OkimuraYusuke IwasawaHitomi YanakaYutaka MatsuoPublished in: CoRR (2024)
Keyphrases
- language specific
- language model
- n gram
- out of vocabulary
- pre trained
- language modeling
- cross lingual
- language independent
- speech recognition
- retrieval model
- document retrieval
- probabilistic model
- machine translation
- information retrieval
- query expansion
- bag of words
- test collection
- natural language
- training data
- neural network
- query terms
- vector space model
- translation model
- relevance model
- training examples
- text retrieval
- text classification
- supervised learning