Self and Cross-Model Distillation for LLMs: Effective Methods for Refusal Pattern Alignment.
Jie LiYi LiuChongyang LiuXiaoning RenLing ShiWeisong SunYinxing XuePublished in: CoRR (2024)
Keyphrases
- data sets
- statistical models
- computational model
- formal model
- theoretical analysis
- management system
- probabilistic model
- prior knowledge
- preprocessing
- pattern matching
- mathematical model
- qualitative and quantitative
- statistical methods
- linear regression
- mathematical models
- hybrid method
- linear models
- machine learning methods
- parameter estimation
- cost function
- feature space
- objective function