Exploring Training on Heterogeneous Data with Mixture of Low-rank Adapters.
Yuhang ZhouZihua ZhaoHaolin LiSiyuan DuJiangchao YaoYa ZhangYanfeng WangPublished in: CoRR (2024)
Keyphrases
- low rank
- heterogeneous data
- high dimensional data
- convex optimization
- matrix factorization
- linear combination
- missing data
- low rank matrix
- matrix completion
- data management
- data integration
- rank minimization
- singular value decomposition
- data sources
- complex data
- semi supervised
- high order
- databases
- trace norm
- metadata
- stochastic gradient descent
- high dimensional
- training set
- dimensionality reduction
- singular values
- web data
- data representation
- data matrix
- feature extraction
- least squares