Optimizing Optimizers: Regret-optimal gradient descent algorithms.
Philippe CasgrainAnastasis KratsiosPublished in: CoRR (2021)
Keyphrases
- worst case
- learning algorithm
- feature selection
- objective function
- significant improvement
- computational cost
- optimization problems
- optimization methods
- lower bound
- online learning
- computationally efficient
- theoretical analysis
- online algorithms
- upper confidence bound
- optimality criterion
- approximately optimal
- confidence bounds
- data sets
- finding optimal
- loss function
- computational complexity
- database systems
- neural network