FitHuBERT: Going Thinner and Deeper for Knowledge Distillation of Speech Self-Supervised Learning.
Yeonghyeon LeeKangwook JangJahyun GooYoungmoon JungHoirin KimPublished in: CoRR (2022)
Keyphrases
- learning systems
- prior knowledge
- knowledge acquisition
- learning algorithm
- learning process
- reinforcement learning
- learned knowledge
- knowledge base
- effective learning
- knowledge level
- knowledge transfer
- learning tasks
- learning problems
- solving problems
- supervised learning
- user interface
- background knowledge
- knowledge sources
- learning content
- unsupervised learning
- online learning
- complex domains
- subject matter
- language acquisition