Pretraining Federated Text Models for Next Word Prediction.

Joel Stremmel Arjun Singh

Published in: CoRR (2020)

Keyphrases

prediction model
keywords
probabilistic model
prediction accuracy
natural language text
text retrieval
statistical models
n gram
co occurrence
neural network
web documents
data sources
digital libraries
sentence level
related words
lexical features
word counts