The Implicit Bias for Adaptive Optimization Algorithms on Homogeneous Neural Networks.
Bohan WangQi MengWei ChenTie-Yan LiuPublished in: ICML (2021)
Keyphrases
- neural network
- optimization problems
- data sets
- optimization methods
- combinatorial optimization
- orders of magnitude
- theoretical analysis
- data structure
- computational complexity
- discrete optimization
- approximately optimal
- stochastic gradient
- adaptive algorithms
- worst case
- fuzzy logic
- computational cost
- significant improvement
- artificial neural networks
- genetic algorithm
- linear programming
- global convergence
- stochastic search
- optimization approaches
- machine learning