Is it worth it? Budget-related evaluation metrics for model selection.
Filip KlubickaGiancarlo D. SaltonJohn D. KelleherPublished in: LREC (2018)
Keyphrases
- model selection
- evaluation metrics
- cross validation
- precision and recall
- hyperparameters
- bayesian learning
- parameter estimation
- regression model
- sample size
- feature selection
- variable selection
- error estimation
- statistical inference
- generalization error
- machine learning
- selection criterion
- model selection criteria
- mixture model
- evaluation measures
- information criterion
- gaussian process
- marginal likelihood
- automatic model selection
- learning to rank
- information retrieval
- parameter determination
- information retrieval systems
- bayesian information criterion
- data mining