LoRA: Low-Rank Adaptation of Large Language Models.
Edward J. HuYelong ShenPhillip WallisZeyuan Allen-ZhuYuanzhi LiShean WangLu WangWeizhu ChenPublished in: ICLR (2022)
Keyphrases
- language model
- low rank
- agent technology
- language modeling
- convex optimization
- matrix factorization
- missing data
- linear combination
- matrix completion
- low rank matrix
- singular value decomposition
- high order
- probabilistic model
- rank minimization
- n gram
- high dimensional data
- document retrieval
- semi supervised
- retrieval model
- query expansion
- information retrieval
- trace norm
- test collection
- query terms
- smoothing methods
- language models for information retrieval
- vector space model
- software agents
- machine learning