Diversifying the Mixture-of-Experts Representation for Language Models with Orthogonal Optimizer.
Boan LiuLiang DingLi ShenKeqin PengYu CaoDazhao ChengDacheng TaoPublished in: CoRR (2023)
Keyphrases
- language model
- mixture model
- language modeling
- document retrieval
- n gram
- probabilistic model
- statistical language models
- speech recognition
- retrieval model
- query expansion
- language modelling
- information retrieval
- translation model
- test collection
- language models for information retrieval
- language model for information retrieval
- expert finding
- context sensitive
- pseudo relevance feedback
- vector space model
- document ranking
- smoothing methods
- query terms
- bayesian networks
- passage retrieval
- error rate
- ad hoc information retrieval
- image retrieval