ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators.
Kevin ClarkMinh-Thang LuongQuoc V. LeChristopher D. ManningPublished in: ICLR (2020)
Keyphrases
- information retrieval
- training process
- neural network
- text retrieval
- text documents
- training set
- web documents
- training phase
- automatically extracted
- document analysis
- error propagation
- natural language generation
- training corpus
- object detection
- training samples
- semantic information
- keywords
- training data
- free text
- database
- training algorithm