Enhancing Few-Shot Learning in Lightweight Models via Dual-Faceted Knowledge Distillation.
Bojun ZhouTianyu ChengJiahao ZhaoChunkai YanLing JiangXinsong ZhangJuping GuPublished in: Sensors (2024)
Keyphrases
- lightweight
- knowledge acquisition
- prior knowledge
- learning systems
- previously learned
- learning algorithm
- learning tasks
- learning models
- learned knowledge
- knowledge transfer
- learned models
- domain knowledge
- accurate models
- knowledge representation
- reinforcement learning
- knowledge base
- complex domains
- background knowledge
- structured prediction
- knowledge sharing
- machine learning
- qualitative models
- learning process
- anomaly detection
- probabilistic model
- wireless sensor networks
- expert systems