ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators.

Kevin Clark Minh-Thang Luong Quoc V. Le Christopher D. Manning

Published in: CoRR (2020)

Keyphrases

test set
training set
text information
textual data
free text
keywords
training examples
information retrieval
web documents
supervised learning
text mining
image retrieval
image sequences
textual information
website
training phase
neural network