Hydra: Multi-head Low-rank Adaptation for Parameter Efficient Fine-tuning.
Sanghyeon KimHyunmo YangYounghyun KimYoungjoon HongEunbyung ParkPublished in: CoRR (2023)
Keyphrases
- fine tuning
- low rank
- low rank matrix
- singular value decomposition
- missing data
- convex optimization
- matrix factorization
- linear combination
- rank minimization
- matrix decomposition
- matrix completion
- high order
- non rigid structure from motion
- trace norm
- robust principal component analysis
- low rank matrices
- pairwise
- minimization problems
- fine tuned
- singular values
- kernel matrix
- high dimensional data
- higher order