STKD: Distilling Knowledge From Synchronous Teaching for Efficient Model Compression.
Tongtong SuJinsong ZhangZhaoyang YuGang WangXiaoguang LiuPublished in: IEEE Trans. Neural Networks Learn. Syst. (2023)
Keyphrases
- prior knowledge
- experimental data
- formal model
- computational model
- statistical model
- learning systems
- probabilistic model
- knowledge acquisition
- high level
- mathematical model
- probability distribution
- conceptual model
- conceptual framework
- wavelet transform
- management system
- additional knowledge
- knowledge about the world