The Role of Momentum Parameters in the Optimal Convergence of Adaptive Polyak's Heavy-ball Methods.

Wei Tao Sheng Long Gaowei Wu Qing Tao

Published in: ICLR (2021)

Keyphrases

machine learning methods
computational cost
image restoration
parameter settings
preprocessing
parameter estimation
cross validation
data sets
computer vision
significant improvement
empirical studies
benchmark datasets
convergence rate
exhaustive search
optimal parameters