PeriodicLoRA: Breaking the Low-Rank Bottleneck in LoRA Optimization.
Xiangdi MengDamai DaiWeiyao LuoZhe YangShaoxiang WuXiaochen WangPeiyi WangQingxiu DongLiang ChenZhifang SuiPublished in: CoRR (2024)
Keyphrases
- low rank
- convex optimization
- nuclear norm
- low rank matrix
- linear combination
- matrix factorization
- missing data
- matrix completion
- singular value decomposition
- agent technology
- matrix decomposition
- rank minimization
- high dimensional data
- trace norm
- semi supervised
- high order
- kernel matrix
- norm minimization
- optimization methods
- low rank matrices
- convex relaxation
- data mining
- singular values
- linear programming
- least squares
- small number
- information retrieval