Task-agnostic Distillation of Encoder-Decoder Language Models.
Chen ZhangYang YangJingang WangDawei SongPublished in: CoRR (2023)
Keyphrases
- language model
- video codec
- decoding process
- distributed video coding
- error control
- wyner ziv
- noisy channel
- low complexity
- language modeling
- rate distortion
- distributed source coding
- successive approximation
- n gram
- wyner ziv video coding
- video coding
- document retrieval
- turbo codes
- probabilistic model
- speech recognition
- language modelling
- information retrieval
- retrieval model
- error resilience
- error correction
- bit rate
- query expansion
- video compression
- bit budget
- test collection
- context sensitive
- motion estimation
- relevance model
- coding scheme
- statistical language models
- document length
- ad hoc information retrieval
- query terms
- pseudo relevance feedback
- video quality
- language model for information retrieval
- decoding algorithm
- translation model
- vector space model
- smoothing methods
- error concealment
- motion vectors
- information retrieval systems
- computational complexity