RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization.

Xijie Huang Zechun Liu Shih-Yang Liu Kwang-Ting Cheng

Published in: CoRR (2024)

Keyphrases

fine tuning
viable alternative
outlier detection
high quality
artificial neural networks
weighting scheme
fine tune
decision making
e learning
decision trees
bayesian networks
objective function
intrusion detection
information processing
novelty detection