DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule.
Maor IvgiOliver HinderYair CarmonPublished in: CoRR (2023)
Keyphrases
- step size
- parameter free
- stochastic gradient descent
- cost function
- convergence speed
- convergence rate
- categorical data
- outlier detection
- steepest descent method
- variable step size
- matrix factorization
- support vector machine
- real world
- differential evolution
- fully automatic
- image segmentation
- gradient method
- image processing
- data mining