Healing Powers of BERT: How Task-Specific Fine-Tuning Recovers Corrupted Language Models.
Shijie HanZhenyu ZhangAndrei Arsene SimionPublished in: CoRR (2024)
Keyphrases
- fine tuning
- language model
- language modeling
- n gram
- document retrieval
- probabilistic model
- viable alternative
- information retrieval
- test collection
- fine tune
- language modelling
- query expansion
- context sensitive
- statistical language models
- retrieval model
- vector space model
- speech recognition
- fine tuned
- ad hoc information retrieval
- query terms
- relevance model
- language models for information retrieval
- collaborative filtering
- pseudo relevance feedback
- document ranking
- smoothing methods
- translation model
- word error rate
- passage retrieval
- cross lingual
- domain specific
- language model for information retrieval