Towards Fine-tuning Pre-trained Language Models with Integer Forward and Backward Propagation.
Mohammadreza TayaranianAlireza GhaffariMarzieh S. TahaeiMehdi RezagholizadehMasoud AsgharianVahid Partovi NiaPublished in: EACL (Findings) (2023)
Keyphrases
- fine tuning
- language model
- forward and backward
- pre trained
- language modeling
- training data
- n gram
- probabilistic model
- document retrieval
- speech recognition
- information retrieval
- test collection
- training examples
- language modelling
- query expansion
- retrieval model
- statistical language models
- dynamic programming
- control signals
- smoothing methods
- greedy search
- small number
- learning algorithm
- machine learning
- language models for information retrieval
- support vector
- search engine