A Frustratingly Easy Post-Training Quantization Scheme for LLMs.

Yongkweon Jeon Chungman Lee Kyungphil Park Ho-Young Kim

Published in: EMNLP (2023)

Keyphrases

quantization scheme
compression scheme
quantization error
rate control
locally adaptive
image processing
face recognition
wavelet coefficients
matching pursuit