Knowledge Distillation from Language Model to Acoustic Model: A Hierarchical Multi-Task Learning Approach.

Mun-Hak Lee Joon-Hyuk Chang

Published in: ICASSP (2022)

Keyphrases

language model
multi task learning
n gram
probabilistic model
multi task
learning tasks
gaussian processes
knowledge acquisition
context sensitive
transfer learning
learning problems
mixture model
prior knowledge
hidden markov models
high order
bayesian inference
text mining
multi class