Scalable One-Pass Optimisation of High-Dimensional Weight-Update Hyperparameters by Implicit Differentiation.
Ross M. ClarkeElre T. OldewageJosé Miguel Hernández-LobatoPublished in: CoRR (2021)
Keyphrases
- hyperparameters
- weight update
- high dimensional
- model selection
- cross validation
- parameter space
- closed form
- bayesian inference
- random sampling
- bayesian framework
- support vector
- neural network
- maximum likelihood
- sample size
- prior information
- em algorithm
- noise level
- gaussian processes
- maximum a posteriori
- back propagation
- incremental learning
- online training
- missing values
- low dimensional
- dimensionality reduction
- incomplete data
- learning rate
- genetic algorithm
- parameter settings
- high dimensional data
- data points
- active learning
- prior knowledge
- regression model
- image processing
- spiking neural networks
- feature space