DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing.

Pengcheng He Jianfeng Gao Weizhu Chen

Published in: CoRR (2021)

Keyphrases

image gradient
training set
supervised learning
training examples
test set
training algorithm
training process
robust image watermarking
data hiding
data sharing
information sharing
weighted sums
knowledge sharing
vector space
feature extraction
online learning
signal processing
semi supervised
training data