Efficient Transformer Knowledge Distillation: A Performance Review.
Nathan BrownAshton WilliamsonTahj AndersonLogan LawrencePublished in: CoRR (2023)
Keyphrases
- knowledge base
- real time
- knowledge acquisition
- prior knowledge
- knowledge extraction
- knowledge discovery
- computationally efficient
- data mining techniques
- database
- knowledge representation
- domain knowledge
- database systems
- data sets
- data streams
- decision making
- genetic algorithm
- learning systems
- fault diagnosis
- cost effective
- conceptual model
- knowledge structures
- literature review