ORPO: Monolithic Preference Optimization without Reference Model.

Jiwoo Hong Noah Lee James Thorne

Published in: CoRR (2024)

Keyphrases

reference model
reference models
metamodel
optimization method
software architecture
optimization problems
optimization algorithm