Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning.
Beliz GunelJingfei DuAlexis ConneauVes StoyanovPublished in: CoRR (2020)
Keyphrases
- language model
- fine tuning
- learning algorithm
- supervised learning
- n gram
- language modeling
- learning process
- probabilistic model
- unsupervised learning
- information retrieval
- context sensitive
- document retrieval
- pre trained
- object tracking
- query expansion
- retrieval model
- active learning
- feature selection
- neural network
- smoothing methods
- data sets