Supervision Complexity and its Role in Knowledge Distillation.
Hrayr HarutyunyanAnkit Singh RawatAditya Krishna MenonSeungyeon KimSanjiv KumarPublished in: ICLR (2023)
Keyphrases
- domain knowledge
- knowledge sources
- data mining techniques
- domain experts
- high level
- computational complexity
- expert systems
- knowledge extraction
- raw data
- knowledge representation
- human cognition
- knowledge transfer
- background knowledge
- worst case
- database
- active learning
- prior knowledge
- evolutionary algorithm
- knowledge base