Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning.
Beliz GunelJingfei DuAlexis ConneauVeselin StoyanovPublished in: ICLR (2021)
Keyphrases
- language model
- fine tuning
- language modeling
- learning algorithm
- supervised learning
- unsupervised learning
- reinforcement learning
- learning process
- speech recognition
- hidden markov models
- n gram
- semi supervised
- context sensitive
- document retrieval
- information retrieval
- neural network
- prior knowledge
- bayesian networks
- feature selection
- machine learning