The Cost of Compression: Investigating the Impact of Compression on Parametric Knowledge in Language Models.
Satya Sai Srinath NamburiMakesh SreedharSrinath SrinivasanFrederic SalaPublished in: CoRR (2023)
Keyphrases
- language model
- language modeling
- probabilistic model
- n gram
- query expansion
- speech recognition
- retrieval model
- statistical language models
- document retrieval
- knowledge discovery
- language modelling
- retrieval effectiveness
- vector space model
- test collection
- information retrieval
- context sensitive
- error rate
- document ranking
- word error rate
- ad hoc information retrieval
- language models for information retrieval