Supervised Contrastive Learning as Multi-Objective Optimization for Fine-Tuning Large Pre-trained Language Models.
Youness MoukafihMounir GhoghoKamel SmaïliPublished in: CoRR (2022)
Keyphrases
- language model
- multi objective optimization
- fine tuning
- learning algorithm
- multi objective
- supervised learning
- evolutionary algorithm
- language modeling
- active learning
- learning process
- pre trained
- unsupervised learning
- speech recognition
- document retrieval
- probabilistic model
- reinforcement learning
- n gram
- document ranking
- query expansion
- bayesian networks
- machine learning
- nsga ii
- statistical language models
- retrieval model
- test collection
- graph cuts
- prior knowledge
- information retrieval