Self-Tuning Networks: Bilevel Optimization of Hyperparameters using Structured Best-Response Functions.
Matthew MacKayPaul VicolJonathan LorraineDavid DuvenaudRoger B. GrossePublished in: CoRR (2019)
Keyphrases
- hyperparameters
- model selection
- cross validation
- support vector
- bayesian inference
- grid search
- parameter optimization
- prior information
- em algorithm
- closed form
- bayesian framework
- gaussian process
- gaussian processes
- noise level
- random sampling
- sample size
- bilevel programming
- incomplete data
- incremental learning
- maximum a posteriori
- maximum likelihood
- linear programming
- multiscale
- parameter values
- pairwise
- optimality conditions
- convex programming