m2mKD: Module-to-Module Knowledge Distillation for Modular Transformers.
Ka Man LoYiming LiangWenyu DuYuantao FanZili WangWenhao HuangLei MaJie FuPublished in: CoRR (2024)
Keyphrases
- domain knowledge
- knowledge base
- knowledge acquisition
- knowledge discovery
- real world
- concept maps
- learning systems
- knowledge management
- knowledge representation
- information technology
- data mining techniques
- reinforcement learning
- knowledge based systems
- data mining
- self organizing maps
- data sets
- knowledge extraction