SKILL: Similarity-aware Knowledge distILLation for Speech Self-Supervised Learning.
Luca ZampierinGhouthi Boukli HaceneBac NguyenMirco RavanelliPublished in: CoRR (2024)
Keyphrases
- prior knowledge
- knowledge transfer
- background knowledge
- learned knowledge
- knowledge acquisition
- learning systems
- learning mechanism
- knowledge level
- learning process
- effective learning
- human experts
- learning tasks
- knowledge sharing
- domain knowledge
- similarity measure
- learning algorithm
- acquire knowledge
- motor skills
- language acquisition
- reinforcement learning
- knowledge base