Decoder-Only or Encoder-Decoder? Interpreting Language Model as a Regularized Encoder-Decoder.
Zihao FuWai LamQian YuAnthony Man-Cho SoShengding HuZhiyuan LiuNigel CollierPublished in: CoRR (2023)
Keyphrases
- decoding process
- video codec
- language model
- distributed video coding
- low complexity
- error control
- noisy channel
- wyner ziv
- successive approximation
- distributed source coding
- wyner ziv video coding
- rate distortion
- video coding
- turbo codes
- motion estimation
- error concealment
- language modeling
- transform domain
- n gram
- bit rate
- information retrieval
- video compression
- video quality
- error resilience
- document retrieval
- speech recognition
- bit budget
- mixture model
- vector space model
- context sensitive