Fast Randomized Low-Rank Adaptation of Pre-trained Language Models with PAC Regularization.
Zijian LeiDong QianWilliam CheungPublished in: ACL (Findings) (2024)
Keyphrases
- language model
- low rank
- pre trained
- rank minimization
- trace norm
- training data
- missing data
- convex optimization
- matrix factorization
- probabilistic model
- linear combination
- speech recognition
- matrix completion
- singular value decomposition
- training examples
- high dimensional data
- semi supervised
- information retrieval
- high order
- feature extraction
- particle filter
- image classification
- small number
- data points
- support vector
- computer vision