Adversarial Data Augmentation for Task-Specific Knowledge Distillation of Pre-trained Transformers.

Minjia Zhang Uma-Naresh Niranjan Yuxiong He

Published in: AAAI (2022)

Keyphrases

data sets
pre trained
decision trees
training data
feature space
knowledge discovery
training samples
real time
neural network
machine learning
feature extraction
prior knowledge
text mining
high dimensional data