Resolving Discrepancies in Compute-Optimal Scaling of Language Models.

Tomer Porian Mitchell Wortsman Jenia Jitsev Ludwig Schmidt Yair Carmon

Published in: CoRR (2024)

Keyphrases

language model
language modeling
probabilistic model
n gram
document retrieval
information retrieval

language modelling
retrieval model
speech recognition
context sensitive
statistical language models
test collection

query expansion
ad hoc information retrieval
language models for information retrieval
translation model
vector space model
document ranking

query terms
smoothing methods
pseudo relevance feedback
information extraction
decision trees