Application of Knowledge Distillation to Multi-task Speech Representation Learning.

Mine Kerpicci Van Nguyen Shuhua Zhang Erik Visser

Published in: CoRR (2022)

Keyphrases

multi task
multi task learning
learning tasks
multiple tasks
knowledge acquisition
prior knowledge

learning problems
transfer knowledge
sparse learning
learning process
multitask learning

knowledge discovery
gaussian processes
reinforcement learning
denoising
supervised learning

multi class
image features
inductive learning
active learning
training data