Login / Signup
Continual Pre-Training of Large Language Models: How to (re)warm your model?
Kshitij Gupta
Benjamin Thérien
Adam Ibrahim
Mats L. Richter
Quentin Anthony
Eugene Belilovsky
Irina Rish
Timothée Lesort
Published in:
CoRR (2023)
Keyphrases
</>
language model
probabilistic model
statistical model
language modeling
feature selection
training set
active learning
query expansion
mixture model
test collection
retrieval model
context sensitive
context dependent
relevance model
statistical language models