Accelerating Multi-Exit BERT Inference via Curriculum Learning and Knowledge Distillation.
Shengwei GuXiangfeng LuoXinzhi WangYike GuoPublished in: Int. J. Softw. Eng. Knowl. Eng. (2023)
Keyphrases
- learning systems
- knowledge acquisition
- prior knowledge
- learning algorithm
- knowledge transfer
- background knowledge
- learning process
- learning tasks
- reinforcement learning
- elementary school
- supervised learning
- online learning
- domain knowledge
- structured prediction
- primary school
- learned knowledge
- learning analytics
- inference process
- learning goals
- learning gains