Mitigating Outlier Activations in Low-Precision Fine-Tuning of Language Models.
Alireza GhaffariJustin YuMahsa Ghazvini NejadMasoud AsgharianBoxing ChenVahid Partovi NiaPublished in: ICPRAM (2024)
Keyphrases
- fine tuning
- language model
- language modeling
- document retrieval
- n gram
- viable alternative
- speech recognition
- information retrieval
- language modelling
- fine tune
- ad hoc information retrieval
- context sensitive
- probabilistic model
- statistical language models
- test collection
- fine tuned
- query expansion
- retrieval model
- language models for information retrieval
- novelty detection
- query terms
- term dependencies
- translation model
- relevance model
- document length
- word error rate
- vector space model
- text categorization
- language model for information retrieval