Improving Multi-fidelity Optimization with a Recurring Learning Rate for Hyperparameter Tuning.
HyunJae LeeGihyeon LeeJunhwan KimSungjun ChoDohyun KimDonggeun YooPublished in: CoRR (2022)
Keyphrases
- learning rate
- convergence rate
- learning algorithm
- error function
- adaptive learning rate
- multilayer neural networks
- rapid convergence
- convergence speed
- hidden layer
- optimization method
- optimization methods
- gaussian processes
- activation function
- optimization algorithm
- step size
- weight vector
- global convergence
- hyperparameters
- neural network
- model selection
- particle swarm optimization
- pairwise
- genetic algorithm
- data mining