Resonance RoPE: Improving Context Length Generalization of Large Language Models.
Suyuchen WangIvan KobyzevPeng LuMehdi RezagholizadehBang LiuPublished in: ACL (Findings) (2024)
Keyphrases
- language model
- language modeling
- context sensitive
- n gram
- language modelling
- speech recognition
- test collection
- information retrieval
- probabilistic model
- query expansion
- document retrieval
- statistical language models
- retrieval model
- vector space model
- language model for information retrieval
- clustering algorithm
- pseudo relevance feedback
- relevance model
- document ranking
- decision trees
- language models for information retrieval
- query terms
- term dependencies
- smoothing methods
- text classification
- document length
- ad hoc information retrieval