PQK: Model Compression via Pruning, Quantization, and Knowledge Distillation.

Jangho Kim Simyung Chang Nojun Kwak

Published in: CoRR (2021)

Keyphrases

computational model
formal model
mathematical model
management system
prior knowledge
domain knowledge
conceptual model

statistical model
expert knowledge
knowledge acquisition
data sets
probabilistic model
computational complexity
objective function

multiscale
high level
additional knowledge
conceptual framework
formal representation
knowledge management

experimental data
domain experts
cost function
multiresolution
expert systems
learning algorithm