Continuation KD: Improved Knowledge Distillation through the Lens of Continuation Optimization.
Aref JafariIvan KobyzevMehdi RezagholizadehPascal PoupartAli GhodsiPublished in: EMNLP (Findings) (2022)
Keyphrases
- knowledge acquisition
- global optimization
- optimization process
- domain knowledge
- data mining techniques
- constrained optimization
- knowledge base
- evolutionary algorithm
- optimization method
- knowledge sharing
- knowledge discovery
- knowledge representation
- discrete optimization
- data sets
- prior knowledge
- expert systems
- artificial intelligence
- genetic algorithm
- machine learning