Fine-Tuning Language Models with Just Forward Passes.

Sadhika Malladi Tianyu Gao Eshaan Nichani Alex Damian Jason D. Lee Danqi Chen Sanjeev Arora

Published in: CoRR (2023)

Keyphrases

language model
fine tuning
language modeling
n gram
viable alternative
fine tune
probabilistic model

speech recognition
document retrieval
information retrieval
query expansion
language modelling
retrieval model
context sensitive

statistical language models
query terms
test collection
fine tuned
term dependencies
document ranking
smoothing methods

ad hoc information retrieval
document length
language model for information retrieval
relevance model
word error rate
web search
decision trees