Oracle Teacher: Leveraging Target Information for Better Knowledge Distillation of CTC Models.
Ji Won YoonHyung Yong KimHyeonseung LeeSunghwan AhnNam Soo KimPublished in: IEEE ACM Trans. Audio Speech Lang. Process. (2023)
Keyphrases
- prior knowledge
- domain knowledge
- information sharing
- domain experts
- information from multiple sources
- historical data
- background knowledge
- information processing
- information sources
- raw data
- knowledge sources
- expert knowledge
- expert systems
- information overload
- data mining tools
- previously learned
- semantic information
- spatial information
- knowledge management
- knowledge sharing
- multiple sources
- global information
- neural network