Weight Averaging Improves Knowledge Distillation under Domain Shift.
Valeriy BerezovskiyNikita MorozovPublished in: CoRR (2023)
Keyphrases
- domain experts
- knowledge base
- meta knowledge
- knowledge extraction
- knowledge sharing
- knowledge management
- domain ontology
- domain knowledge
- domain independent
- knowledge based systems
- deep knowledge
- general knowledge
- complex domains
- knowledge transfer
- semantic information
- knowledge representation
- prior knowledge
- expert systems
- learning systems
- data mining techniques
- domain specific
- knowledge discovery
- learning process
- domain dependent
- learned knowledge
- artificial intelligence
- domain models
- data sets
- knowledge acquired
- real time