Automatic prior selection for meta Bayesian optimization with a case study on tuning deep neural network optimizers.
Zi WangGeorge E. DahlKevin SwerskyChansoo LeeZelda MarietZachary NadoJustin GilmerJasper SnoekZoubin GhahramaniPublished in: CoRR (2021)
Keyphrases
- neural network
- fine tuning
- optimization methods
- optimization problems
- semi automatic
- belief nets
- artificial neural networks
- global optimization
- image reconstruction from projections
- efficient optimization
- neural network model
- optimization algorithm
- prior distribution
- back propagation
- genetic algorithm
- bayesian networks
- prior probabilities
- bayesian inference
- pattern recognition
- data driven
- bp neural network
- prior knowledge
- bayesian model
- prior information
- fuzzy logic
- case study
- bayesian methods
- bayesian models
- highly non linear
- feature selection
- fault diagnosis