CLAQ: Pushing the Limits of Low-Bit Post-Training Quantization for LLMs.

Haoyu Wang Bei Liu Hang Shao Bo Xiao Ke Zeng Guanglu Wan Yanmin Qian

Published in: CoRR (2024)

Keyphrases

uniform quantization
training set
training samples
training data
high levels
supervised learning
training examples
training algorithm
training phase
test set
quantization step
adaptive quantization
multi layer perceptron
training process
neural network
multiscale
genetic algorithm
machine learning