Distilling Hubert with LSTMs via Decoupled Knowledge Distillation.
Danilo de OliveiraTimo GerkmannPublished in: ICASSP (2024)
Keyphrases
- domain knowledge
- prior knowledge
- knowledge extraction
- data mining techniques
- information retrieval
- knowledge base
- neural network
- knowledge discovery
- search algorithm
- learning process
- genetic algorithm
- knowledge representation
- multiscale
- knowledge management
- decision trees
- knowledge acquisition
- knowledge based systems
- case base
- expert knowledge
- information systems