Exploring the impact of low-rank adaptation on the performance, efficiency, and regularization of RLHF.
Simeng SunDhawal GuptaMohit IyyerPublished in: CoRR (2023)
Keyphrases
- low rank
- rank minimization
- trace norm
- minimization problems
- matrix factorization
- group sparsity
- convex optimization
- linear combination
- kernel matrices
- missing data
- low rank matrix
- singular value decomposition
- kernel matrix
- matrix completion
- high order
- matrix decomposition
- high dimensional data
- semi supervised
- low rank matrices
- robust principal component analysis
- multi task
- norm minimization
- low rank approximation
- object detection
- pairwise
- data analysis