Efficient pre-training objectives for Transformers.

Luca Di Liello Matteo Gabburo Alessandro Moschitti

Published in: CoRR (2021)

Keyphrases

supervised learning
cost effective
data sets
information systems
three dimensional
training set
trade off
hidden markov models
support vector machine
test set
computationally expensive
training algorithm
multiple objectives
training phase