Task-agnostic Distillation of Encoder-Decoder Language Models.
Chen ZhangYang YangQiuchi LiJingang WangDawei SongPublished in: LREC/COLING (2024)
Keyphrases
- language model
- decoding process
- video codec
- distributed video coding
- error control
- low complexity
- wyner ziv
- noisy channel
- language modeling
- rate distortion
- wyner ziv video coding
- distributed source coding
- successive approximation
- n gram
- video coding
- probabilistic model
- document retrieval
- language modelling
- information retrieval
- speech recognition
- retrieval model
- error resilience
- context sensitive
- test collection
- ad hoc information retrieval
- turbo codes
- vector space model
- bit budget
- video compression
- query expansion
- pseudo relevance feedback
- bit rate
- motion estimation
- error concealment
- translation model
- query terms
- language model for information retrieval
- smoothing methods
- decoding algorithm
- okapi bm
- error correction
- motion vectors