An Efficient Method of Training Small Models for Regression Problems with Knowledge Distillation.

Makoto Takamoto Yusuke Morishita Hitoshi Imaoka

Published in: MIPR (2020)

Keyphrases

regression problems
linear regression
prior knowledge
pairwise
genetic programming
energy function
cross validation
machine learning methods
support vector machine
feature set
semi supervised learning
missing data
bayesian framework
probabilistic model
training process
training algorithm
feature selection