Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language Models.
Tianyi TangWenyang LuoHaoyang HuangDongdong ZhangXiaolei WangXin ZhaoFuru WeiJi-Rong WenPublished in: CoRR (2024)
Keyphrases
- language specific
- language model
- n gram
- out of vocabulary
- language modeling
- cross lingual
- language independent
- speech recognition
- document retrieval
- probabilistic model
- machine translation
- retrieval model
- test collection
- information retrieval
- query expansion
- bag of words
- translation model
- vector space model
- natural language
- query terms
- named entity recognition
- pseudo relevance feedback
- relevance model
- word segmentation
- machine learning
- text mining
- natural language processing
- document representation
- active learning
- labor intensive