Beyond Memorization: The Challenge of Random Memory Access in Language Models.
Tongyao ZhuQian LiuLiang PangZhengbao JiangMin-Yen KanMin LinPublished in: ACL (1) (2024)
Keyphrases
- language model
- memory access
- language modeling
- data access
- probabilistic model
- n gram
- document retrieval
- information retrieval
- query expansion
- retrieval model
- test collection
- memory management
- smoothing methods
- external memory
- main memory
- data storage
- shared memory
- relevance model
- query terms
- database systems
- high volume
- access patterns
- co occurrence
- processing units
- language models for information retrieval