LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning.
Rui PanXiang LiuShizhe DiaoRenjie PiJipeng ZhangChi HanTong ZhangPublished in: CoRR (2024)
Keyphrases
- fine tuning
- importance sampling
- memory efficient
- language model
- monte carlo
- language modeling
- markov chain
- kalman filter
- n gram
- probabilistic model
- information retrieval
- particle filter
- smoothing methods
- mixture model
- approximate inference
- query expansion
- particle filtering
- ad hoc information retrieval
- posterior distribution
- markov chain monte carlo
- bayesian inference
- belief propagation
- machine learning