Knowledge Distillation for Neural Transducers from Large Self-Supervised Pre-Trained Models.

Xiaoyu Yang Qiujia Li Philip C. Woodland

Published in: ICASSP (2022)

Keyphrases

pre trained
prior knowledge
neural network
decision trees
wide range
face detection
data sets
learning algorithm