Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling.

Pratyush Maini Skyler Seto He Bai David Grangier Yizhe Zhang Navdeep Jaitly

Published in: CoRR (2024)

Keyphrases

language modeling
data analysis
data sets
database
web pages
learning algorithm
information retrieval systems
training data
association rules
probabilistic model
web search
query expansion
web documents
statistical language models