Enhancing Scalability of Pre-trained Language Models via Efficient Parameter Sharing.
Peiyu LiuZe-Feng GaoYushuo ChenXin ZhaoJi-Rong WenPublished in: EMNLP (Findings) (2023)
Keyphrases
- language model
- language modeling
- pre trained
- n gram
- speech recognition
- document retrieval
- probabilistic model
- information retrieval
- language modelling
- statistical language models
- query expansion
- language models for information retrieval
- retrieval model
- document ranking
- test collection
- relevance model
- supervised learning
- image retrieval
- high dimensional
- training data
- data sets