Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language Models.
Adway GirishAlliot NagleMarco BondaschiMichael GastparAshok Vardhan MakkuvaHyeji KimPublished in: CoRR (2024)
Keyphrases
- black box
- language model
- rate distortion
- probabilistic model
- bit rate
- video coding
- language modeling
- black boxes
- bit allocation
- rate control
- fundamental limits
- relevance model
- n gram
- image compression
- motion estimation
- computational complexity
- rate distortion theory
- image quality
- white box
- low complexity
- macroblock
- scalable video coding
- bayesian networks
- distributed video coding
- adaptive quantization
- bit plane
- machine learning
- wavelet coding
- information retrieval
- image coder
- retrieval model
- test cases