Understanding Multi-phase Optimization Dynamics and Rich Nonlinear Behaviors of ReLU Networks.
Mingze WangChao MaPublished in: NeurIPS (2023)
Keyphrases
- emergent behavior
- highly nonlinear
- complex systems
- nonlinear optimization
- agent based simulations
- optimization problems
- optimization algorithm
- global optimization
- nonlinear dynamics
- social networks
- sequential quadratic programming
- echo state networks
- dynamic behavior
- dynamic model
- dynamical systems
- heterogeneous networks
- network dynamics
- training phase
- optimization process
- behavioral patterns
- network analysis
- complex networks
- optimization method
- high level
- real world