Do we need Label Regularization to Fine-tune Pre-trained Language Models?
Ivan KobyzevAref JafariMehdi RezagholizadehTianda LiAlan Do-OmriPeng LuPascal PoupartAli GhodsiPublished in: EACL (2023)
Keyphrases
- language model
- fine tune
- pre trained
- language modeling
- training data
- fine tuning
- probabilistic model
- speech recognition
- n gram
- document retrieval
- language modelling
- training examples
- retrieval model
- query expansion
- multi label
- information retrieval
- test collection
- smoothing methods
- relevance model
- statistical language models
- control signals
- multi modal
- language models for information retrieval
- statistical language modeling
- pid controller
- knn
- pattern recognition
- search engine