TensorGPT: Efficient Compression of the Embedding Layer in LLMs based on the Tensor-Train Decomposition.

Mingxue Xu Yao Lei Xu Danilo P. Mandic

Published in: CoRR (2023)

Keyphrases

efficient compression
tensor decomposition
higher quality
bit rate
video compression
image compression
high order
vector space
video coding
video codec
dimensionality reduction
motion compensation
feature extraction
video data
low bit rate
diffusion tensor
image quality