Bayesian-LoRA: LoRA based Parameter Efficient Fine-Tuning using Optimal Quantization levels and Rank Values trough Differentiable Bayesian Gates.
Cristian MeoKsenia SychevaAnirudh GoyalJustin DauwelsPublished in: CoRR (2024)
Keyphrases
- agent technology
- fine tuning
- parameter values
- bayesian decision
- bayesian networks
- bayesian estimation
- mobile agents
- web intelligence
- viable alternative
- objective function
- software agents
- posterior probability
- efficient optimization
- bayesian inference
- bayesian learning
- probabilistic model
- scoring metrics
- dynamic programming
- optimal parameters
- electronic commerce
- maximum likelihood
- closed form
- intelligent agents