Understanding Multi-phase Optimization Dynamics and Rich Nonlinear Behaviors of ReLU Networks.
Mingze WangChao MaPublished in: CoRR (2023)
Keyphrases
- highly nonlinear
- agent based simulations
- recurrent networks
- optimization algorithm
- nonlinear dynamics
- optimization problems
- global optimization
- computer networks
- dynamic behavior
- real world
- emergent behavior
- optimization process
- dynamic model
- complex systems
- social networks
- network analysis
- training phase
- learning phase
- community structure
- nonlinear optimization
- optimization method
- dynamical systems
- temporal behavior
- network dynamics
- neural network
- minority game