SDQ: Sparse Decomposed Quantization for LLM Inference.

Geonhwa Jeong Po-An Tsai Stephen W. Keckler Tushar Krishna

Published in: CoRR (2024)

Keyphrases

sparse data
sparse representation
high dimensional
probabilistic inference
image processing
bayesian inference
quantization noise
belief networks
random fields
feature extraction
bayesian networks
inference engine
bayesian model