Accurate LoRA-Finetuning Quantization of LLMs via Information Retention.
Haotong QinXudong MaXingyu ZhengXiaoyang LiYang ZhangShouda LiuJie LuoXianglong LiuMichele MagnoPublished in: CoRR (2024)
Keyphrases
- information sources
- information sharing
- end users
- keywords
- information content
- spatial information
- information processing
- domain knowledge
- information technology
- social media
- long term
- high accuracy
- intelligent systems
- prior knowledge
- multiresolution
- contextual information
- vector quantization
- artificial neural networks
- raw data
- artificial intelligence