PAC-tuning: Fine-tuning Pre-trained Language Models with PAC-driven Perturbed Gradient Descent.
Guangliang LiuZhiyu XueXitong ZhangKristen Marie JohnsonRongrong WangPublished in: EMNLP (2023)
Keyphrases
- fine tuning
- language model
- pre trained
- language modeling
- fine tune
- document retrieval
- n gram
- fine tuned
- probabilistic model
- information retrieval
- language modelling
- test collection
- speech recognition
- retrieval model
- smoothing methods
- query expansion
- statistical language models
- training data
- machine learning
- relevance model
- document ranking
- action recognition
- information retrieval systems
- pairwise
- feature selection