HomoDistil: Homotopic Task-Agnostic Distillation of Pre-trained Transformers.

Chen Liang Haoming Jiang Zheng Li Xianfeng Tang Bing Yin Tuo Zhao

Published in: ICLR (2023)

Keyphrases

pre trained
training data
training examples
control signals
image sequences
real time
computer vision
wide range
small number