Transformer-based ASR Incorporating Time-reduction Layer and Fine-tuning with Self-Knowledge Distillation.
Md. Akmal HaidarChao XingMehdi RezagholizadehPublished in: CoRR (2021)
Keyphrases
- fine tuning
- knowledge acquisition
- domain knowledge
- knowledge base
- fine tune
- knowledge management
- prior knowledge
- raw data
- knowledge sharing
- database
- databases
- knowledge transfer
- multi layer
- domain experts
- information retrieval
- expert systems
- background knowledge
- decision making
- data mining
- expert knowledge
- genetic algorithm
- automatic speech recognition
- artificial neural networks
- viable alternative