LoNAS: Elastic Low-Rank Adapters for Efficient Large Language Models.
Juan Pablo MuñozJinjie YuanYi ZhengNilesh JainPublished in: LREC/COLING (2024)
Keyphrases
- language model
- low rank
- language modeling
- n gram
- document retrieval
- probabilistic model
- missing data
- convex optimization
- matrix factorization
- matrix completion
- test collection
- linear combination
- query expansion
- retrieval model
- singular value decomposition
- low rank matrix
- rank minimization
- language models for information retrieval
- smoothing methods
- statistical language models
- information retrieval
- semi supervised
- high order
- decision trees
- high dimensional data
- recommender systems
- bayesian networks
- search engine
- learning algorithm