Towards Understanding Label Regularization for Fine-tuning Pre-trained Language Models.
Ivan KobyzevAref JafariMehdi RezagholizadehTianda LiAlan Do-OmriPeng LuAli GhodsiPascal PoupartPublished in: CoRR (2022)
Keyphrases
- language model
- fine tuning
- pre trained
- language modeling
- n gram
- language modelling
- probabilistic model
- document retrieval
- speech recognition
- information retrieval
- retrieval model
- test collection
- statistical language models
- smoothing methods
- query expansion
- fine tuned
- training data
- multi label
- training examples
- relevance model
- data sets
- control signals