Sparse is Enough in Fine-tuning Pre-trained Large Language Model.
Weixi SongZuchao LiLefei ZhangHai ZhaoBo DuPublished in: CoRR (2023)
Keyphrases
- language model
- fine tuning
- pre trained
- language modeling
- n gram
- training data
- probabilistic model
- query expansion
- document retrieval
- information retrieval
- retrieval model
- speech recognition
- control signals
- context sensitive
- training examples
- ad hoc information retrieval
- mixture model
- high dimensional
- smoothing methods
- test collection
- translation model
- training set
- sparse representation
- relevance model
- image classification
- knn
- image segmentation
- computer vision