Linear Interpolation In Parameter Space is Good Enough for Fine-Tuned Language Models.
Mark RofinNikita BalaganskyDaniil GavrilovPublished in: CoRR (2022)
Keyphrases
- parameter space
- linear interpolation
- language model
- fine tuned
- fine tuning
- language modeling
- probabilistic model
- n gram
- high dimensional
- information retrieval
- language modelling
- document retrieval
- domain specific
- speech recognition
- query expansion
- optimization scheme
- retrieval model
- mixture model
- test collection
- smoothing methods
- statistical language models
- post processing
- interpolation method
- search space
- partial differential equations
- object recognition
- document ranking
- relevance model