DenseMamba: State Space Models with Dense Hidden Connection for Efficient Large Language Models.
Wei HeKai HanYehui TangChengcheng WangYujie YangTianyu GuoYunhe WangPublished in: CoRR (2024)
Keyphrases
- language model
- probabilistic model
- state space
- language modelling
- language modeling
- relevance model
- statistical language models
- information retrieval
- query expansion
- document retrieval
- retrieval model
- language model for information retrieval
- probabilistic retrieval models
- language models for information retrieval
- test collection
- n gram
- document ranking
- smoothing methods
- context sensitive
- statistical models
- ad hoc information retrieval
- generative model