Login / Signup
Characterizing Learning Curves During Language Model Pre-Training: Learning, Forgetting, and Stability.
Tyler A. Chang
Zhuowen Tu
Benjamin K. Bergen
Published in:
CoRR (2023)
Keyphrases
</>
language model
learning curves
supervised learning
learning curve
language modeling
learning process
probabilistic model
query expansion
n gram
incremental learning
learning algorithm
learning tasks
learning problems
information retrieval
unsupervised learning
mixture model