Beyond Implicit Bias: The Insignificance of SGD Noise in Online Learning.
Nikhil VyasDepen MorwaniRosie ZhaoGal KaplunSham M. KakadeBoaz BarakPublished in: CoRR (2023)
Keyphrases
- online learning
- distance education
- higher education
- blended learning
- noise level
- noise model
- computer mediated
- distance learning
- missing data
- e learning
- noise reduction
- signal to noise ratio
- random noise
- online course
- image noise
- adverse effect
- input data
- stochastic gradient descent
- data sets
- gaussian noise
- decision trees
- lower bound
- noise free
- color images
- online algorithms
- cost function
- bias variance
- least squares