DroPacter : Compacter-based Tuning with Layer Freezing in Pre-Trained Language Model.
Saurabh AnandShubham MalaviyaManish ShuklaSachin LodhaPublished in: SAC (2024)
Keyphrases
- language model
- pre trained
- language modeling
- training data
- document retrieval
- n gram
- probabilistic model
- speech recognition
- retrieval model
- training examples
- query expansion
- information retrieval
- context sensitive
- control signals
- test collection
- mixture model
- active learning
- smoothing methods
- translation model
- computer vision
- ad hoc information retrieval
- generative model
- pairwise
- learning algorithm
- neural network