HomoDistil: Homotopic Task-Agnostic Distillation of Pre-trained Transformers.

Chen Liang Haoming Jiang Zheng Li Xianfeng Tang Bin Yin Tuo Zhao

Published in: CoRR (2023)

Keyphrases

pre trained
training examples
training data
control signals
small number
neural network
learning process
single image