Accelerate Distributed Stochastic Descent for Nonconvex Optimization with Momentum.
Guojing CongTianyi LiuPublished in: MLHPC/AI4S@SC (2020)
Keyphrases
- optimization problems
- global optimization
- stochastic optimization
- distributed systems
- distributed environment
- optimization algorithm
- stochastic programming
- nonlinear programming
- monte carlo
- autonomy oriented computing
- cooperative
- optimization process
- objective function
- optimal control problems
- stochastic search
- communication cost
- constrained optimization
- fault tolerant
- lightweight
- multi agent
- optimal control
- learning rate
- optimization methods
- distributed data
- stochastic model
- convergence rate
- peer to peer
- data sets