Login / Signup
QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs.
Saleh Ashkboos
Amirkeivan Mohtashami
Maximilian L. Croci
Bo Li
Martin Jaggi
Dan Alistarh
Torsten Hoefler
James Hensman
Published in:
CoRR (2024)
Keyphrases
</>
outlier detection
probabilistic inference
databases
bayesian networks
novelty detection
inference process
data sets
machine learning
artificial intelligence
case study
expert systems
special case
hidden markov models
inference engine