Knowledge Transfer from Large-scale Pretrained Language Models to End-to-end Speech Recognizers.
Yotaro KuboShigeki KaritaMichiel BacchianiPublished in: CoRR (2022)
Keyphrases
- end to end
- language model
- knowledge transfer
- speech recognition
- speech recognizers
- speech recognizer
- language modeling
- automatic speech recognition
- knowledge sharing
- probabilistic model
- n gram
- retrieval model
- document retrieval
- transfer learning
- information retrieval
- cross domain
- learning tasks
- test collection
- real world
- out of vocabulary
- query expansion
- query terms
- reinforcement learning
- pattern recognition
- information retrieval systems
- speech signal
- neural network
- pairwise
- hidden markov models
- cross lingual
- relevance model
- translation model
- data mining