Should We Be Pre-training? An Argument for End-task Aware Training as an Alternative.

Lucio M. Dery Paul Michel Ameet Talwalkar Graham Neubig

Published in: ICLR (2022)

Keyphrases

artificial intelligence
training set
supervised learning
training examples
training process
training algorithm
small number
database
social networks
multiscale
test set
feed forward neural networks
computer software