Efficient Knowledge Distillation from Model Checkpoints.
Chaofei WangQisen YangRui HuangShiji SongGao HuangPublished in: CoRR (2022)
Keyphrases
- mathematical model
- computational model
- domain knowledge
- probabilistic model
- prior knowledge
- conceptual model
- knowledge representation
- semantic models
- database
- statistical model
- knowledge discovery
- objective function
- decision making
- neural network
- real time
- learning environment
- reinforcement learning
- management system
- knowledge acquisition
- similarity measure
- machine learning
- prediction model
- formal representation
- additional knowledge