Efficient Transformer Knowledge Distillation: A Performance Review.

Nathan Brown Ashton Williamson Tahj Anderson Logan Lawrence

Published in: EMNLP (Industry Track) (2023)

Keyphrases

knowledge base
domain knowledge
knowledge acquisition
computationally expensive
knowledge extraction
data sets
expert systems
prior knowledge
knowledge representation
computationally efficient
reinforcement learning
digital libraries
data mining techniques
higher level
lightweight
cost effective