Hyperparameter Optimization: Foundations, Algorithms, Best Practices and Open Challenges.
Bernd BischlMartin BinderMichel LangTobias PielokJakob RichterStefan CoorsJanek ThomasTheresa UllmannMarc BeckerAnne-Laure BoulesteixDifan DengMarius LindauerPublished in: CoRR (2021)
Keyphrases
- optimization problems
- discrete optimization
- orders of magnitude
- computational complexity
- computational cost
- machine learning algorithms
- theoretical analysis
- optimization methods
- lessons learned
- times faster
- computationally efficient
- significant improvement
- convex optimization
- global optimization
- stochastic search
- optimization procedure
- data sets
- optimization algorithm
- model selection
- maximum likelihood
- probabilistic model
- feature selection
- data mining