Supervised Contrastive Learning as Multi-Objective Optimization for Fine-Tuning Large Pre-Trained Language Models.
Youness MoukafihMounir GhoghoKamel SmaïliPublished in: ICASSP (2023)
Keyphrases
- language model
- multi objective optimization
- fine tuning
- learning algorithm
- multi objective
- language modeling
- evolutionary algorithm
- learning process
- statistical language models
- pre trained
- differential evolution
- supervised learning
- probabilistic model
- unsupervised learning
- n gram
- document retrieval
- video sequences
- feature selection
- small number
- speech recognition
- active learning
- support vector
- multi objective optimization problems
- language modelling
- reinforcement learning