Enhancing LLM Safety via Constrained Direct Preference Optimization.
Zixuan LiuXiaolin SunZizhan ZhengPublished in: CoRR (2024)
Keyphrases
- concave convex procedure
- optimization algorithm
- optimization method
- multi attribute
- optimization strategies
- optimization process
- optimization methods
- global optimization
- data sets
- artificial intelligence
- database
- information retrieval
- constrained optimization
- optimal design
- preference relations
- joint optimization
- hard constraints
- preference elicitation
- real time