An Elementary Approach to Convergence Guarantees of Optimization Algorithms for Deep Networks.
Vincent RouletZaïd HarchaouiPublished in: CoRR (2020)
Keyphrases
- optimization problems
- discrete optimization
- global convergence
- orders of magnitude
- data structure
- quasi newton
- convergence analysis
- significant improvement
- worst case
- computationally efficient
- approximately optimal
- learning algorithm
- optimization methods
- combinatorial optimization
- optimization algorithm
- theoretical analysis
- particle swarm optimization
- linear programming
- constrained optimization
- iterative algorithms
- machine learning algorithms
- evolutionary algorithm
- update rule
- stopping criteria
- rapid convergence