Login / Signup
DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining.
Sang Michael Xie
Hieu Pham
Xuanyi Dong
Nan Du
Hanxiao Liu
Yifeng Lu
Percy Liang
Quoc V. Le
Tengyu Ma
Adams Wei Yu
Published in:
CoRR (2023)
Keyphrases
</>
language model
test collection
document retrieval
retrieval model
statistical language models