Is it worth it? Budget-related evaluation metrics for model selection.
Filip KlubickaGiancarlo D. SaltonJohn D. KelleherPublished in: CoRR (2018)
Keyphrases
- model selection
- evaluation metrics
- cross validation
- precision and recall
- hyperparameters
- sample size
- bayesian learning
- parameter estimation
- error estimation
- model selection criteria
- regression model
- variable selection
- machine learning
- information criterion
- learning to rank
- evaluation measures
- generalization error
- feature selection
- gaussian process
- mixture model
- selection criterion
- statistical inference
- information extraction
- mutual information
- marginal likelihood
- parameter determination