APMSqueeze: A Communication Efficient Adam-Preconditioned Momentum SGD Algorithm.
Hanlin TangShaoduo GanSamyam RajbhandariXiangru LianJi LiuYuxiong HeCe ZhangPublished in: CoRR (2020)
Keyphrases
- dynamic programming
- single pass
- theoretical analysis
- cost function
- experimental evaluation
- matching algorithm
- high accuracy
- optimal solution
- times faster
- learning algorithm
- high efficiency
- convergence rate
- monte carlo
- computationally efficient
- particle swarm optimization
- computational cost
- objective function
- preprocessing
- search space
- k means
- detection algorithm
- linear programming
- segmentation algorithm
- computationally expensive
- significant improvement
- computational complexity
- highly efficient
- training algorithm
- neural network
- pruning strategy
- levenberg marquardt
- stochastic gradient descent