Insights into Pre-training via Simpler Synthetic Tasks.

Yuhuai Wu Felix Li Percy Liang

Published in: CoRR (2022)

Keyphrases

training examples
data mining
database systems
multi class
feedforward neural networks
real world
learning algorithm
search engine
training data
digital libraries
test set
training process